Storage Access Framework Performance

Viewing 9 posts - 1 through 9 (of 9 total)
  • Author
    Posts
  • #9045
    admin
    Keymaster

    What is SAF?
    SAF (Storage Access Framework) is google’s replacement for direct file access – the way how applications worked with files and folders before android 11. If application upgrades to compatibility with android 11 then it looses direct file access and must use SAF. There are special applications which google listed like a compatible with direct access, but emulators are not there. And it is disaster. However, at the end of the list is written that application which are broken too much can request direct file access. It must be manually granted by google. The solution what google provides is a unfortunate, because we really don’t need access to whole file system, but we need fast file access and this is available only with granted permission to ‘ALL FILES’.

    So, why has Magic Dosbox so big problem with SAF?
    Problem is in inconsistent performance. Before SAF were files and folders accessed very fast, it really helped to already performance sensitive emulator to be not laggy and without choppy sound. SAF communicates through IPC with some kind of process or daemon. This communication is slow, there are delays and the same file operation can be another time way slower then same operation few milliseconds before. This significantly increases loading times and makes emulation inconsistent. In the ancient DOS were problems with amount of RAM in computers, so programmers quickly created file, dumped data and returned them back with followed file deletion. This means, DOS programs constantly do something with files, not only at startup, but during runtime. This is the worst, it does not affect only loading times.

    Another problem is how big differences are in execution times of each file operations. It varies per device, per android 11 update, per count of files on device and per who knows what. At 5th october I received new update for my Google Pixel 3XL. I ran storage test application before and after update. While file creation time stayed at the some performance, file deletion was doubled after update. Seems file deletion is pain in the ass and google has problems fix it, it constantly shows performance issues across tested devices with android 11.

    Private folder
    We can still use private folder. It is without restrictions at original performance. But, whole content is deleted when is application uninstalled. Google introduced flag “keepFragileData” which should prevent deletion by uninstallation. But whole concept of this flag is so stupidly made that I lost everything inside private folder several times during development. Copying something there and from is insanely slow, backuping takes ages. You will lost possibility sharing games with other emulators. Data are completely not safe inside this folder. If you are going try few games, it can be allright. If you have big collection then it is unusable.

    Why is here this topic?
    I hope, gathering enough information about saf performance can win for us access to direct file operations.

    Test application
    I created simple application for testing storage. It does 3 basic file operations executed on storage with direct files access and on SAF storage. It does:

    • File create
    • File open
    • File delete

    You can download it here. If you want test it, you must grant ‘all files’ as first step. This grants access and creates test folder ‘saftest’ in root of your storage (/storage/emulated/0/saftest). In next step, grant SAF permission the folder ‘saftest’. If are both permissions granted then you can test your storage performance. ‘File create’ creates file with unique name. ‘File open’ opens this file and adds there some text. ‘File delete’ deletes this file. You must do it step by step, else newly created file will have another name and file deletion does not recognize it. If you press file delete before file create then it crashes. It does not matter, it is a test.

    Screenshot_01

    Can I test SAF already now?
    Magic Dosbox implements SAF since android 5, due access to sdcard. You can test it already now. Just create some folder on internal storage and instead sdcard, grant access on this folder.

    What means these times in the table below for me?
    Depends on emulated application or game. Deletion was cheap operation in DOS time and before android 11, now is not. For me is now hard to tell why dos application decided to rewrite file with “deleted file + create file” instead file truncate. But they did it this way. I tried several DOS editors for Pascal, Borland C, DosUAE or Fellow. All do it this way while editing text files. The games do the same for temp files, instead rewrite they delete it and create again, repeatedly. Realms of Arkania 3 creates and deletes more than 10 temp files in moment, uses them for a second and deletes them. This is done several times from the start to the first in-game scene. Both delete and file create are expensive operations in SAF.

    Please, if you are on android 10 and higher, test your device and report result. I hope it will help.

    Results from devices are below. First results are always slower. Probably SAF initializes something. First column is device name, next 3 columns are results using “ALL FILES” flag. The last 3 columns are gathered from SAF.

    Device Create Open Delete SAF Create SAF Open SAF Delete
    Samsung A50(a11) 2-3ms 2-3ms 2-3ms 27-96ms 8-16ms 483-580ms
    Samsung Gal.TabS6Lite(a11) 2-6ms 2-3ms 1-2ms 31-45ms 10-11ms 33-45ms
    Google Pixel3XL(a11) 1-2ms 2-3ms 1-2ms 19-77ms 9-27ms 113-139ms

    UPDATE 25.10.2021

    I spend a lot of time on the SAF research and I discovered very strange things. I recorded it and created quick video. Is available here for download. Please note, is not finished, is rough and far from sleek, however it shows the SAF battlenecks. I just hurt my right arm, so things are slowered, sorry.

    in addition, google fu…d important api and must be emulated while using SAF. With granted all files is not broken

    https://issuetracker.google.com/issues/199091106

    After watching the video above is clear that table above cant be linked to exact device, because SAF file performance depends a lot on count files on your device, every new file makes it slower.

    But I need results from players, because I need arguments for google that magic dosbox cannot work effectively with SAF and is hurt by SAF too much.

    #9192
    SongJiang
    Participant

    Hi ! I’m sorry I tried to test it on my Huawei P30 pro (android 10) and cannot get working.
    When I click on ‘All Files’ it open me the app informations. I can uninstall it or force it to stop and get some information about data. I take care to let the app access to the storage. But the folder saftest isn’t created. Do I have to create this folder myself?

    #9200
    admin
    Keymaster

    Aah, sorry, i know what is wrong. Tomorrkow I will fix it. Many thanks:)

    #9202
    admin
    Keymaster

    fixed. On android 10 must be SAF in the downloads and all files is requested in old way.

    #9203
    SongJiang
    Participant

    Ok so I don’t know if results will help:
    20
    6
    65
    (Results are between 15-30/5-8/55-70. Very flexible.

    Direct c++ results are:
    1
    1
    1

    #9204
    admin
    Keymaster

    Many thanks, it will help:)

    #9213
    Al ex
    Keymaster

    You’re not alone… look at this: https://www.facebook.com/neutroncode/posts/126476879755838
    And this guy is a really good programmer, Neutron is hands down the best, most advanced audio player for mobile devices.

    #9214
    Al ex
    Keymaster

    Here are my results (Galaxy S9+, Android 10, no modifications):
    SAF Create 65,7
    SAF Open 12,2
    SAF Delete 31,8
    C++ Create 0,8
    C++ Open 0,2
    C++ Delete 0,4

    I ran each test 10x, then calculated the average in an Excel spreadsheet. The SAF results were also extremely inconsistent (from 56 to 88, even after I had deleted one 126ms result as random spike). I’ll send you those results via email.

    #9216
    admin
    Keymaster

    Thank you a lot

Viewing 9 posts - 1 through 9 (of 9 total)
  • You must be logged in to reply to this topic.