Dealing with many files: Difference between revisions

From Helpful
Jump to navigation Jump to search
mNo edit summary
mNo edit summary
Line 3: Line 3:


(When you want to '''watch/monitor''' a large amount of files for change, see [[File polling and event notification]])
(When you want to '''watch/monitor''' a large amount of files for change, see [[File polling and event notification]])
The below is more about the practicalities of ''keeping'' many files around.


<!--
<!--
Note that filesystems are essentially databases, which just tend to deal with partial failures better.
Note that filesystems are essentially databases (that tend to deal with partial failures better).


The issue in the context of many files is that there is slowness in  
The issue in the context of many files is that there is slowness in  

Revision as of 17:33, 20 January 2024

📃 These are primarily notes, intended to be a collection of useful fragments, that will probably never be complete in any sense.


(When you want to watch/monitor a large amount of files for change, see File polling and event notification)

The below is more about the practicalities of keeping many files around.


Potential issues with many files: partly the filesystem, partly the uses

On permission checks

On stat()

Splitting off directories

Notes on fragmentation

some filesystem properties