“POSIX has been the standard file system interface for Unix-based systems (which includes Linux) since its launch more than 30 years ago,” writes Enterprise Storage Forum, noting the POSIX-compliant Lustre file system “powers most supercomputers.”
Now Slashdot reader storagedude writes:
POSIX has scalability and performance limitations that will become increasingly important in data-intensive applications like deep learning, but until now it has retained one key advantage over the infinitely scalable object storage: the ability to process data in memory. That advantage is now gone with the new mmap_obj() function, which paves the way for object storage to become the preferred approach to Big Data applications.
POSIX features like statefulness, prescriptive metadata, and strong consistency “become a performance bottleneck as I/O requests multiply and data scale…” claims the article.
“The mmap_obj() developers note that one piece of work still needs to be done: there needs to be a munmap_obj() function to release data from the user space, similar to the POSIX function.”
of this story at Slashdot.
Source:: Slashdot