PS3 sMAN v1.10n (by deank): New features & improved performance & stability

A couple of new updates aiding in the evolution of the sMAN plugin has been seen in recent days as developer @deank continues to add functionality and as you see in the screenshot additional eye-candy as well. Following up on v0.08n, deank officially labled v1.09 as a Beta Release as several new things were implemented and went through some testing phases. Deank has stated he has almost re-written sMAN so much that it now almost differs from webMAN v1.47n by nearly 50% according to the guy who know (the developer of both plugin) deank. Also thanks to freddy38510 NTFS drives will show the actual time & date stamps in both FTP & the file explore in web-browsers. v0.10n was recently released as well and officially moved from Beta to the next Stable update , that did just that improve the stability & performance of things like the www client . This plugin keeps improving and new features continue to impress as deank's continues to put his magically touches on this ps3 plugin.​

sMAN v0.10n sMAN v0.09n (beta notes)

• 
  
  sMAN v0.10n​
  In the latest sman.sprx update the internal web server will use threads to serve files/images content. It will no longer hold the whole www client thread and will release the resources immediatelly greatly improving performance and stability. Until now if you download something big via the web interface and then try to browse games or refresh sman would lock, but not anymore..
  
  There were some issues with displaying images/files from network locations (ps3netsrv) using the webbrowser but it is now ok. There are also some other minor fixes.
  
  Update to sMAN 1.10n: http://deanbg.com/sman.sprx | http://deanbg.com/sMAN_1.10.zip
  
  Network/ps3netsrv locations should now support about 3200 files (1600 ISO games + 1600 images for example).
  
  p.s. sprx is updated again. If someone with a lot of network games can test it - let me know. I tested it with a folder with 9000 files and it handles 3200 to 3300, so it works.
  
  http://www.psx-place.com/threads/sm...on-sfo-scanning-more.12984/page-10#post-75905
  
  
• 
  I updated sman.sprx - it now has a separate option for dev_blind. sman_res.exe is changed to support .htm resource files. The source is also updated. Web content is now in external .htm files in wmtmp/res folder. It is still work in progress, but at least you can see how it is progressing.
  
  The web-pages are still ugly, but now someone can help with improving them. The external files are:
  
  • www_head.htm - this is present in each generated page and can be edited by a web-designer
  • www_setup.htm - the setup page (only the form)
  • www_foot.htm - the footer
  • www_file.htm - some javascript needed for table sorting (doesn't work on the ps3 browser)
  
  The dynamic content is generated after www_head and before www_foot.
  
  I made some changes to the layout... should be something like this at the moment:
  
  
  ​
  Post Source: http://www.psx-place.com​
  
  
  Spoiler: Post 2

  It should look much better now. You have a very early build. It now doesn't use tables, but I rewrote everything with css. Not really gorgeous, but still simple and lite. Shows 99% the same on the PC and on the PS3 now. Also it fits perfectly even in SD resolution (720x576).
  

  
  ​

  
  Without Javascript the Setup page cannot be used (because js is used to set current options/values), but all other functions are ok.
  
  This option was never clickable. The checkbox was always disabled and its "ticked" state just indicates whether the lowest speed will be applied (which happens only in "auto" mode). I added back the "tick" when in auto-mode - it is purely cosmetic checkbox just to make the options look more ordered on screen.
  
  I updated sman.sprx. Also game listing in the web-browser on the PS3 now looks properly (game names are centered as they should be - same as on the PC).
  
  http://deanbg.com/sman.sprx (now up to 1.09n - resource files will be updated and you'll also get a new background for sMAN GUI).
  Spoiler: Post 3

  sMAN updated (http://deanbg.com/sman.sprx)
  
  I hope this 1.09n version is the last "beta"/"unstable" before the official 1.10. It seems very stable at the moment. I optimized a lot of functions and rewrote a lot of the code - probably over 50% is now completely different compared to webMAN 1.47n.
  
  In this update the optimizations lead to another memory usage decrease - you should now have 2324KB free memory.
  
  FTP browsing is faster - both for hdd/usb and ntfs drives, which means copying a lot of folders will be much faster compared to any wM/sM version.
  
  Along with all the other changes since 1.08 (external web content/additional xmb info tags/code optimizations) 1.09n should be the version to update to without worries.
  
  Dean
  

  
  Post Source: psx-place.com/
  -------------------------------------------------------------------------​
  Spoiler: Post 4

  Thanks to @freddy38510 the ntfs library now supports proper date/time stamps for files/folders. sMAN is updated to show actual date/times in FTP and web-browser for NTFS drives.
  http://www.psx-place.com/threads/li...ilation-with-cellsdk.11906/page-11#post-75770
  
  Thanks @freddy38510
  
  p.s. libntfs_prx.a is also updated in sman_1.09.zip
  
  

  Post Source: psx-place.com
  -------------------------------------------------------------------------​

Download:

• http://deanbg.com/sman.sprx
  
• http://deanbg.com/sMAN_1.10.zip

Source: psx-place.com​

 

@MixeryMaxe raised an important issue although maybe not one occurring frequently. Sooner or later, most users were bound to launch the GUI when they shouldn't & freeze their system. Your changes will ensure it doesn't happen. It's a wise move imho... [emoji6]

Yeah, pretty easy to hit L2+R2 when you throw the controller down on the bed to start watching a movie or something.

 

So you are getting SYS_NET_ERROR_ENOBUFS error - no free network buffers, usually caused by very high rate of filling/emptying the network queue. I'm not sure what to do exactly... I can try to add some artificial delay to see if it will help. At least you got all images 1 or 2 times before it stalled.

 

So you are getting SYS_NET_ERROR_ENOBUFS error - no free network buffers, usually caused by very high rate of filling/emptying the network queue. I'm not sure what to do exactly... I can try to add some artificial delay to see if it will help. At least you got all images 1 or 2 times before it stalled.

Yeah that was loading the games tab a few times in quick succession that got that error. I'll play with it a bit and see if there is anything else going on.

Need to find a way of getting debug output when hooked up to a TV to see why it dies when just using the ps3 browser. That's generally a lot less reliable then doing it remotely and most times will only get a handful of images before dying even on the first boot.

It's not a major problem, everything else works flawlessly. Just odd.

Edit: Managed to do it blind after looking for a screenshot. Just hitting the combo to open sman, pressing triangle, then up, then x to enter the setup page and it threw an error straight up.

Not sure how to get to the games tab blindly though. lol

Looks like it crashed sman completely?
Maybe I should hook it up to the TV for a bit and check file system etc... It's been through a rough time. :P

Edit 2: Ahhh, looking at the TV there is an unload sman option there now... I must of hit that instead of setup! :P

 

I updated sman_test.sprx. You can redownload it and use it for the next tests.

You used unload sman option (/quit.ps3) and sman unloaded properly. When you see "SMAN: prx [EXIT]" it means clean exit/prx-unload - it should stop all threads and release all resources. Someone with dex can check the thread list (@Joonie did it the last time) and see if something remains as zombie.

 

I updated sman_test.sprx. You can redownload it and use it for the next tests.

No worries, about to hook up to the TV and do a quick file system check etc.
Just updated and it threw a different network error while shutting down.

I'll clean her up and get back to it in a bit.

SYS_NET_ERROR_ECONNABORTED

0x80010235

 

Yes, 80010235 and 80010204 are ok - it is when sMAN closes all sockets when shutting down.

 

Hmm, Really need to work a way of getting the TV and ethernet at the same time.

Practiced getting into games tab, refreshing etc blindly. I noticed the first time I used the ps3 browser to show the game list (while on the tv) it got every but one game. In this case Street Fighter X Tekken.

Next time I loaded it (blindly while logging), it pulled everything out of /dev_hdd0/home/00000001/webbrowser/silk/httpcache/ except for Street Fighter X Tekken.

Every time I try to load the games tab blindly on the ps3 browser now it ONLY seems to be pulling up street fighter X tekken and the same cached image a few times.

Very puzzling... Wish I could see what was on screen. :/

Edit: Here's a shot after a refresh...

Log File - http://pastebin.com/raw/uYEnTauW

Tried to download the image from the cache via ftp but it's gone by the time I get there.
I'm wondering if that's whats going on? Trying to used cached data that is already deleted?

It's obviously a different problem then what was happening remotely as that seems to work pretty well now unless I thrash the network loading it too many times, too quickly.

I've got to come up with a better solution so I can log data and see what's happening... This is just too confusing. :/

 

Your log seems ok. No, the issue can't be the cached data, but because the ps3 accesses data on the localhost address (127.0.0.1) which makes it even more faster trying to connect to sman.

 

Yeah, Hooking it up to the TV again on that latest test version everything seems to work quite well now. Just Street Fighter X Tekken is missing every time... Maybe it got corrupted during all the screwing around. I'll replace the image shortly. (although it shows fine remotely, lol)

Otherwise it seems to be working perfectly... It's not stalling and waiting for the page to load or missing bulk images etc.

Done a few refreshes and rapid fire loading of the games tab etc. with perfect results bar that one game everytime. Hoorah!

 

You can clear the PS3 web browser cache and test it.

 

You can clear the PS3 web browser cache and test it.

Hmmm, clearing the cache then loading the games tab It does seem to miss a few covers even after trying to enter it a few times. (seems to just be a bulk lot at the top and/or at the bottom, rather than seemingly at random)

Clearing the cache, then refreshing the games list however seems to bring up all covers (and keep them next time you look at the games tab)

Hasn't done the three beep shutdown at all though which is a bonus.

Edit: Even Street Fighter X Tekken decided to show up this time. haha, not sure what its problem was. :P

Edit 2: OK, after leaving it idle while having dinner and coming back it seems to be missing a few covers again after just going into games without touching anything else.... weird bloody thing. Got the triple beep shutdown again after it stalled loading icons. Heaps better than it was though!

I'll find a way of hooking up the ps3 via ethernet while just using the ps3 browser at some stage to try get some info on what's going on.
Not like the PS3 browser is really useful for mounting games or anything, but still odd.

 

@deank i think i found an small problem while looking at this log

Full log here - http://pastebin.com/raw/RbSgtU6h

When searching for the ps2 covers images is made in this order by file extension ---> .jpg .JPG .png .PNG .jpg

Like this (copyed from self_slaughter pastebin)

open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).jpg
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).JPG
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).png
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).PNG
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).jpg

Note the last .jpg search is repeated (are 5 but should be 4, right?)

 

@deank i think i found an small problem while looking at this log

When searching for the ps2 covers images is made in this order by file extension ---> .jpg .JPG .png .PNG .jpg

Like this (copyed from self_slaughter pastebin)

open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).jpg
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).JPG
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).png
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).PNG
open_path /dev_hdd0/tmp/wmtmp/Syphon Filter 2 (Disc 2).jpg

Note the last .jpg search is repeated (are 5 but should be 4, right?)

That's probably because all my images are lower case jpg files.
It's probably it just going with that after seeing if the others exist?

(Just guessing)

Edit: Could be a potential optimisation in that if that's the case?
If it exists, don't bother looking for the other ones, and if the first one was say an upper case PNG check for that first on the next image? (on ps1/ps2 games anyway)

 

Edit: Could be a potential optimisation in that if that's the case?

Im guessing too but yes, if one is found it could stop searching for the other file extensions, also i would prioritize capitals, so i would use this order
.PNG .JPG .png .jpg

Or if you prefer to prioritize jpeg...
.JPG .PNG .jpg .png

 

Please believe me there is a reason for it to be this way. You can't think of only one specific situation - there are at least 15 different conditions on which an image is copied to wmtmp depending on the source. The search for local files is not a problem, so there is nothing to discuss about it - it is the network issue @self_slaughter is having.

 

Oh btw, I just did a FSM downgrade and cleaned my system right up since I lost all my data anyway.

I can finally install rebug from recovery and petitboot works flawlessly now, so hopefully whatever bug was in my system (assuming from doing a non fsm downgrade by the bloke I paid to downgrade it a while back after an OFW update) may be gone?

Installing linux at the moment, will test sman again a little later on.

So stoked at the moment. Linux was THE reason I bought the PS3 to start with, since I'm quite frequently without a PC
(I know it's not exactly flash, but its internet browser is miles ahead of the ps3 one, and it makes tweaking files a lot easier!)

 

Please believe me there is a reason for it to be this way. You can't think of only one specific situation - there are at least 15 different conditions on which an image is copied to wmtmp depending on the source. The search for local files is not a problem, so there is nothing to discuss about it - it is the network issue @self_slaughter is having.

If there is some reason for it is ok, but one last question, there is no way to identify automatically that scenarios ?
I cant imagine now how many could be so no need to explain them, just with a "no" is ok

And another thing, mostlly incase @Zar wants to add it to managunz (or you for multiman incase you return to it)... this priority i mentioned... are 2 setings, the combination results in 4 variants
-cover extension character case (lower case... or... upper case)
-cover extension format (jpg... or... png)

The point is most of the users are going to have the cover images with the same case, and probably with the same image format
The uncommon thing is if a user has images in several formats, and different case, this should not be considered normal (not much probable)

So well... if the user could choose wich extension has more priority... it could speed up a bit the things
For sMAN doesnt looks a good idea to add new setting for this because you are keeping the settings at minimal for simplicity, but for other backup managers maybe comes in handy

 

What is the "do not focus on disc icon in xmb" option used for?
I do not get it

 

What is the "do not focus on disc icon in xmb" option used for?
I do not get it

After mounting a game in sman, it normally backs out to the game menu, then selects the disc icon after a few seconds so you can just press X to play.

Pretty sure that option stops it trying to automatically move around the xmb to select the disc icon when it's ready.

 

What is the "do not focus on disc icon in xmb" option used for?
I do not get it

With it enabled, after mounting the game, in XMB the cursor moves automatically to top of the bluray icon (with the backup mounted in it)
So you can just press "X" and play