Re: Possible Idea with filesystem buffering.

[Hans Reiser]

Rik van Riel wrote:

>On Mon, 21 Jan 2002, Hans Reiser wrote:
>
>>Rik van Riel wrote:
>>
>
>>>I take it you're volunteering to bring ext3, XFS, JFS,
>>>JFFS2, NFS, the inode & dentry cache and smbfs into
>>>shape so reiserfs won't get unbalanced ?
>>>
>
>>If they use writepage(), then the job of balancing cache cleaning is
>>done, we just use writepage as their pressuring mechanism.
>>Any FS that wants to optimize cleaning can implement a VFS method, and
>>any FS that wants to optimize freeing can implement a VFS method, and
>>all others can use their generic VM current mechanisms.
>>
>
>It seems you're still assuming that different filesystems will
>all see the same kind of load.
>

I don't understand this comment.

>
>
>Freeing cache (or at least, applying pressure) really is a job
>for the VM because none of the filesystems will have any idea
>exactly how busy the other filesystems are.
>

I fully agree, and it is the point I have been making (poorly, since it 
has not
communicated) for as long as I have been discussing it with you.  The VM 
should
apply pressure to the caches.  It should define an interface that 
subcache managers
act in response to.   The larger a subcache is, the more percentage of 
total memory
pressure it should receive.  The amount of memory pressure per unit of 
time should
be determined by the VM.

Note that there are two kinds of pressure, cleaning pressure and freeing 
pressure.
I think that the structure appropriate for delegating them is the same, 
but someone
may correct me.  

Also note that a unit of pressure is a unit of aging, not a unit of
freeing/cleaning.  The application of pressure does not necessarily free 
a page, it
merely ages the subcache, which might or might not free a page depending 
on how much
use is being made of what is in the subcache.

Thus, a subcache receives pressure to grow from somewhere (things like 
write()
in the case of ReiserFS), and pressure to shrink from VM, and VM exerts 
however
much total pressure on all the subcaches is required to not run out of 
memory.

The mechanism of going through pages, seeing what subcache they belong 
to, and
pressuring that subcache, is a decent one (if a bit CPU cache expensive) 
for obtaining
linearly proportional cache pressure.  Since code inertia favors it, 
let's use it for now.

Hans