PS3 sMAN v1.10n (by deank): New features & improved performance & stability

A couple of new updates aiding in the evolution of the sMAN plugin has been seen in recent days as developer @deank continues to add functionality and as you see in the screenshot additional eye-candy as well. Following up on v0.08n, deank officially labled v1.09 as a Beta Release as several new things were implemented and went through some testing phases. Deank has stated he has almost re-written sMAN so much that it now almost differs from webMAN v1.47n by nearly 50% according to the guy who know (the developer of both plugin) deank. Also thanks to freddy38510 NTFS drives will show the actual time & date stamps in both FTP & the file explore in web-browsers. v0.10n was recently released as well and officially moved from Beta to the next Stable update , that did just that improve the stability & performance of things like the www client . This plugin keeps improving and new features continue to impress as deank's continues to put his magically touches on this ps3 plugin.​

sMAN v0.10n sMAN v0.09n (beta notes)

• 
  
  sMAN v0.10n​
  In the latest sman.sprx update the internal web server will use threads to serve files/images content. It will no longer hold the whole www client thread and will release the resources immediatelly greatly improving performance and stability. Until now if you download something big via the web interface and then try to browse games or refresh sman would lock, but not anymore..
  
  There were some issues with displaying images/files from network locations (ps3netsrv) using the webbrowser but it is now ok. There are also some other minor fixes.
  
  Update to sMAN 1.10n: http://deanbg.com/sman.sprx | http://deanbg.com/sMAN_1.10.zip
  
  Network/ps3netsrv locations should now support about 3200 files (1600 ISO games + 1600 images for example).
  
  p.s. sprx is updated again. If someone with a lot of network games can test it - let me know. I tested it with a folder with 9000 files and it handles 3200 to 3300, so it works.
  
  http://www.psx-place.com/threads/sm...on-sfo-scanning-more.12984/page-10#post-75905
  
  
• 
  I updated sman.sprx - it now has a separate option for dev_blind. sman_res.exe is changed to support .htm resource files. The source is also updated. Web content is now in external .htm files in wmtmp/res folder. It is still work in progress, but at least you can see how it is progressing.
  
  The web-pages are still ugly, but now someone can help with improving them. The external files are:
  
  • www_head.htm - this is present in each generated page and can be edited by a web-designer
  • www_setup.htm - the setup page (only the form)
  • www_foot.htm - the footer
  • www_file.htm - some javascript needed for table sorting (doesn't work on the ps3 browser)
  
  The dynamic content is generated after www_head and before www_foot.
  
  I made some changes to the layout... should be something like this at the moment:
  
  
  ​
  Post Source: http://www.psx-place.com​
  
  
  Spoiler: Post 2

  It should look much better now. You have a very early build. It now doesn't use tables, but I rewrote everything with css. Not really gorgeous, but still simple and lite. Shows 99% the same on the PC and on the PS3 now. Also it fits perfectly even in SD resolution (720x576).
  

  
  ​

  
  Without Javascript the Setup page cannot be used (because js is used to set current options/values), but all other functions are ok.
  
  This option was never clickable. The checkbox was always disabled and its "ticked" state just indicates whether the lowest speed will be applied (which happens only in "auto" mode). I added back the "tick" when in auto-mode - it is purely cosmetic checkbox just to make the options look more ordered on screen.
  
  I updated sman.sprx. Also game listing in the web-browser on the PS3 now looks properly (game names are centered as they should be - same as on the PC).
  
  http://deanbg.com/sman.sprx (now up to 1.09n - resource files will be updated and you'll also get a new background for sMAN GUI).
  Spoiler: Post 3

  sMAN updated (http://deanbg.com/sman.sprx)
  
  I hope this 1.09n version is the last "beta"/"unstable" before the official 1.10. It seems very stable at the moment. I optimized a lot of functions and rewrote a lot of the code - probably over 50% is now completely different compared to webMAN 1.47n.
  
  In this update the optimizations lead to another memory usage decrease - you should now have 2324KB free memory.
  
  FTP browsing is faster - both for hdd/usb and ntfs drives, which means copying a lot of folders will be much faster compared to any wM/sM version.
  
  Along with all the other changes since 1.08 (external web content/additional xmb info tags/code optimizations) 1.09n should be the version to update to without worries.
  
  Dean
  

  
  Post Source: psx-place.com/
  -------------------------------------------------------------------------​
  Spoiler: Post 4

  Thanks to @freddy38510 the ntfs library now supports proper date/time stamps for files/folders. sMAN is updated to show actual date/times in FTP and web-browser for NTFS drives.
  http://www.psx-place.com/threads/li...ilation-with-cellsdk.11906/page-11#post-75770
  
  Thanks @freddy38510
  
  p.s. libntfs_prx.a is also updated in sman_1.09.zip
  
  

  Post Source: psx-place.com
  -------------------------------------------------------------------------​

Download:

• http://deanbg.com/sman.sprx
  
• http://deanbg.com/sMAN_1.10.zip

Source: psx-place.com​

 

Rename it to sman.sprx. I already mentioned it in my previous post.

sorry i was in a hurry, and i want to try the sprx very fast so i didn't finish reading your post.

now the fisrt try went bad with ps3netsrv20170310, i will try the original cmd ps3netsrv and i will update my result.

EDIT: sorry but the same result with Habib 4.81 + original ps3netsrv, it freeze my ps3 when it reach the game number 67 in my PS3ISO, even if i change the ISO games by remove the first 100 games from the PS3ISO game.

if wounder why i know it's the game number 67 bc when i use the refresh button from the setup page in my pc with your latest release it show me the games that been scan one by one until it reach number 67 and then the ps3 freeze and i have to hold the power button for a long time to shutdown my ps3.

thanks and sorry if i give you any trouble.

EDIT2: my ps3 is slim CECH-2506A

 

I'll try to create 100 fake game iso files and will test later when I get back from work.

 

Yes, it crashes in vsh after 66 games. I'll see what I can do about it. After the 66th time the netiso plugin is loaded but not started properly by vsh and the following attempt to unload it crashes the system.

For the test I used 100 10MB iso files (just the first 10MB of a normal game ISO).

So the problem is not in the game or ps3netsrv or the process in sman. I guess after 64-65 plugin loads/unloads the PS3 is pi**ed off or it runs out of network sockets or something.

I'll check if the ntfs plugin does the same and if it doesn't then the problem is with the network layer.... Checked - it does the same with the ntfs (rawsec) plugin after 64-65 games. Damn it!

 

@Zoilus & other users experiencing issues with sMan that would require debugging output.

If you feel up to it & your problem requires it, you can get some debug output from Cobra & help @deank figure out the source of your issues.
This is not required for every issue but it usually provides very valuable clues.

To get Cobra Debug output you must first get hold of the Debug stage2.bin for your CFW (for Rebug 4.81.x, look in https://github.com/Joonie86/COBRA-7.3/tree/master/481/REX/BIN/debug).

For CEX:
Get stage2.cex.debug.
Rename your currently used stage2.cex in /dev_flash/rebug/cobra to stage2.cex.release & copy the Debug one renamed as stage2.cex. Reboot.

For DEX:
Get stage2.dex.debug.
Rename your currently used stage2.dex in /dev_flash/rebug/cobra to stage2.dex.release & copy the Debug one renamed as stage2.dex. Reboot.

Of course, once you are done with debugging, you can simply rename the files again to use the release version.

Now that your ps3 is setup, it will broadcast its debug output on UDP, in order to receive it, you need to launch a Linux "socat" command on a pc running on the same lan as the ps3, there are various ways to go about this. You can use either
1. Linux obviously, in a VM or on a PC. Note that depending on the distro & installation choices, socat may not be installed by default.
2. Windows 10 gives you the option to use a Linux sub system called Linux Bash shell. You will need to use apt to install socat.
3. Cygwin or Mingw both offer socat, you will need to install the right package.
4. There is actually a socat for Windows as deank reminded us. I have never needed it so I am not sure whether all features are supported but for such basic relaying, it should do just fine.
You can download Windows socat already compiled here https://github.com/StudioEtrange/socat-Windows or get the source for more recent unofficial builds here http://www.dest-unreach.org/socat/...

Whatever way you choose to run it, the socat command will use UDP protocol & port 18194 to receive the Debug output from Cobra.

Socat is a powerful relay command with many possible ways to redirect the output. However the most simple in this case would be to output to the console with something like:

socat -u udp-recv:18194 stdout

Now you can perform your actions on the PS3 while the terminal console on PC will fill up with Cobra debug output which you can post for devs to consider.
Like I said before, socat can also redirect the Debug output to a file or whatever else you prefer, the choice is vast..

Warning:
Messing with /dev_flash & Cobra files may lead to bricking, especially on NAND systems. Make sure you use the correct files!

 

Yes, it crashes in vsh after 66 games. I'll see what I can do about it. After the 66th time the netiso plugin is loaded but not started by vsh and the following attempt to unload it crashes the system.

For the test I used 100 10MB iso files (just the first 10MB of a normal game ISO).

So the problem is not in the game or ps3netsrv or the process in sman. I guess after 64-65 plugin loads/unloads the PS3 is pi**ed off

dammit, @deank , ur likes r going to overload the system here as well. great job on the plugin, my friend.

 

so guys, i can change if i wish all those icons in res folder? so i download png icons and icons must be in same dimensions, and i refresh it in sman, restart ps3 and icons will be changed?

 

@bokiroki try yourself. I'm nobody over here, buy I insist we should report issues and make suggestions in order to improve the sMAN's core not just these non-vital cosmetic stuff.

 

@Me_TheKing

Well, I managed to get it to work (scanned 130 network ps3 iso games without a problem). I had to reluctantly add a simplified netiso interface inside sman, but that's the cost for it.

I'll post later when I'm ready with the final version. NTFS will be next but I guess it will be for tomorrow.

 

sman.sprx is updated with the fix for 66+ ps3netsrv games. At least now it uses just 6KB of memory for scanning network locations and not 130KB so 124KB less used and it works.

http://deanbg.com/sman.sprx

@Me_TheKing Let me know when you test it.

 

@Me_TheKing

Well, I managed to get it to work (scanned 130 network ps3 iso games without a problem). I had to reluctantly add a simplified netiso interface inside sman, but that's the cost for it.

I'll post later when I'm ready with the final version. NTFS will be next but I guess it will be for tomorrow.

I have in total 120 games in 2 hds external
The previous external HD had 50 games and worked well
I switched from external HD that has 70 games is the ps3 froze when scanning the games

 

sman.sprx is updated with the fix for 66+ ps3netsrv games. At least now it uses just 6KB of memory for scanning network locations and not 130KB so 124KB less used and it works.

http://deanbg.com/sman.sprx

@Me_TheKing Let me know when you test it.

thanks master deank

there is a good news and there is a bad one.
the good news is that my ps3 stope freezing, and the bad news is the ps3netsrv crash and give me this msg in the cmd:
....
Connection from 192.168.15.49
System seems low in resources.
D:\ps3netsrv>

and my pc memory get filled up hahahah lol.

i notice that even after the ps3netsrv crashed and stoped the sman still adding my games to the list but with no cover, and it take for maybe 2-4 sec to add one game to the list.

the test was with Habib 4.81 + original cmd ps3netsrv + 1340 ISO in one folder (no cover image or sfo in the folder) + old workstation pc with 3GB of ram

thanks again

EDIT1: the games that sman load with cover are 620 game befor ps3netsrv crash.
EDIT2: sman freeze my ps3 after it add the game number 1003 to the list, but it's not a hard freeze, i just need to press or click the power button in my ps3 and not hold it, so i think it's a deffrent problem bc of the crashed ps3netsrv, so what i want to say is this not a real problem but i wrote it to give you all the information that i have from my test.

 

@Zoilus & other users experiencing issues with sMan that would require debugging output.

If you feel up to it & your problem requires it, you can get some debug output from Cobra & help @deank figure out the source of your issues.
This is not required for every issue but it usually provides very valuable clues.

To get Cobra Debug output you must first get hold of the Debug stage2.bin for your CFW (for Rebug 4.81.x, look in https://github.com/Joonie86/COBRA-7.3/481/REX/BIN/debug).

For CEX:
Get stage2.cex.debug.
Rename your currently used stage2.cex in /dev_flash/rebug/cobra to stage2.cex.release & copy the Debug one renamed as stage2.cex. Reboot.

For DEX:
Get stage2.dex.debug.
Rename your currently used stage2.dex in /dev_flash/rebug/cobra to stage2.dex.release & copy the Debug one renamed as stage2.dex. Reboot.

Of course, once you are done with debugging, you can simply rename the files again to use the release version.

Now that your ps3 is setup, it will broadcast its debug output on UDP, in order to receive it, you need to launch a Linux "socat" command on a pc running on the same lan as the ps3, there are various ways to go about this. You can use either
1. Linux obviously, in a VM or on a PC. Note that depending on the distro & installation choices, socat may not be installed by default.
2. Windows 10 gives you the option to use a Linux sub system called Linux Bash shell. You will need to use apt to install socat.
3. Cygwin or Mingw both offer socat, you will need to install the right package.

Whatever way you choose to run it, the socat command will use UDP protocol & port 18194 to receive the Debug output from Cobra.

Socat is a powerful relay command with many possible ways to redirect the output. However the most simple in this case would be to output to the console with something like:

socat -u udp-recv:18194 stdout

Now you can perform your actions on the PS3 while the terminal console on PC will fill up with Cobra debug output which you can post for devs to consider.
Like I said before, socat can also redirect the Debug output to a file or whatever if you prefer.

Warning:
Messing with /dev_flash & Cobra files may lead to bricking, especially on NAND systems. Make sure you use the correct files!

Brilliant post. I was wondering how to get a debug output on the ps3.

That link threw a 404 on my end btw. Throwing in a /tree/master/ worked.

https://github.com/Joonie86/COBRA-7.3/tree/master/481/REX/BIN/debug

 

@self_slaughter
Sorry guys.. I typed the Cobra repo url from memory & forgot to add the tree/master part...
I corrected the link in my post.

 

thanks @bguerville that is some great info. and may help. I had yet another viewer/sub report that they just got the fatal error too, today. so im getting the details now. thats 5 including me over the last few days.

hey my Raspberry pi 3 is connected to the same network as the ps..can i use that? it has Raspbian (debian jesse) as well as ubuntu mate and fedora mate...i use ubuntu the most tho. would I have to set up or get anything first before running that line?

 

thanks @bguerville that is some great info. and may help. I had yet another viewer/sub report that they just got the fatal error too, today. so im getting the details now. thats 5 including me over the last few days.

hey my Raspberry pi 3 is connected to the same network as the ps..can i use that? it has Raspbian (debian jesse) as well as ubuntu mate and fedora mate...i use ubuntu the most tho. would I have to set up or get anything first before running that line?

Of course you can use your Raspberry Pi! Any distro will be fine. Remember you may need to apt (or rpm) the socat package if it is not already installed.

Originally I think netcat should have been able to deal with such a case but netcat does not support UDP very well. In some cases udp support is even removed entirely.

Of course there are many other ways than socat to receive data via udp, it can be done with perl or python in 3 or 4 lines for instance... Socat remains the easiest though...

 

Of course you can use your Raspberry Pi! Any distro will be fine. Remember you may need to apt (or rpm) the socat package if it is not already installed.

Originally I think netcat should have been able to deal with such a case but netcat does not support UDP very well. In some cases udp support is even removed entirely.

Of course there are many other ways than socat to receive data via udp, it can be done with perl or python in 3 or 4 lines for instance... Socat remains the easiest though...

so once I set it all up basically i have to run sman and get the fatal error maybe do it once or twice...then after that I can just change the name of the one i named "release" back to its original name and just delete the "debug" one?

seems easy enough... once i change everything back...where will all the info be located? sorry never used socat before


sudo apt-get install socat <-------- just ignore that im putting it here so i don't forget it lol I have pages filled with all kinds of stuff for my Rpi3 but need to find it

 

so once I set it all up basically i have to run sman and get the fatal error maybe do it once or twice...then after that I can just change the name of the one i named "release" back to its original name and just delete the "debug" one?

seems easy enough... once i change everything back...where will all the info be located? sorry never used socat before


sudo apt-get install socat <-------- just ignore that im putting it here so i don't forget it lol I have pages filled with all kinds of stuff for my Rpi3 but need to find it

Yes you need to use sudo apt-get install socat.
If you use the command from my previous post, the output will be fed to the console so you will need to cut & paste the parts you need.
Otherwise you could change the command slightly to output everything to a log file.
From the top of my head, something like this should work....

socat -u UDP-RECV:18194 OPEN:/tmp/cobra_dbg.log,creat,append

Like I said socat is powerful & can do pretty much anything with the data it receives so for other ways to output, you will need to "man socat(1)" on Linux & check the syntax.

 

@bguerville thanks again man... I think that cobra log will work fine... so basically it will keep "writing" to the log until i rename the "release" one back to its original name and reboot?

 

@bguerville thanks again man... I think that cobra log will work fine... so basically it will keep "writing" to the log until i rename the "release" one back to its original name and reboot?

As long as you use debug stage2.bin, Cobra will broadcast its debug output via UDP. You need to setup the socat client to receive the data of course. When the socat command is stopped, logging on the client side will stop too...while the broadcast actually continues on the console side.

 

ok , yeah thats pretty logical ..alright well now I just have to wait for it to happen again....although im actually going to do everything i did before to see if it comes back...the only way to solve it was to wipe my hdd completely ... so right now its fine...but i think i can get it to do it again