OPL with prototype game list cache

[Peppe90]

Don't you find it strange that you have a HDD unit, leave it on AUTO but don't use it for most of your tasks?
If you wish to add the option, you're free to do it.

As I Always say I like the immediacy of consoles (FHDB with a full huge HDD is to slow fro my tastes to even boot the ps2) plus I want to reserve all the HDD space for Ps2 games (I've only mbr, +OPL [128mb] and HDL [128mb] partitions, aside games). For this I prefer the HDD to don't even spin up if not necessary…
About POPS too, I prefer to use it from USB or (even better) from SMB (I use one of this 10$ mini-router/NAS with a usb device connected to it). I do many tests, trying to make the Ps1 games to work (with Patches, cheats, etc...) and it's faster and I think safer to do it with just a pendrive (connected via SMB) instead of installing and deleting ps1 games a lot of times on iHDD.

I see. But it doesn't mean the game didn't try to read data.
Either way, it is working, to the best of my knowledge. How I tested it, was with a specialized program that issued the IDLE command (standby timer = 5s) and waited for 10s. At the 5th second, I could hear the spindown.

Well, I'll make further tests, Thank you. Btw, I said well, this function works only when playing a game from iHDD? It won't work If I launch a USB game, right??

Yes. In fact, this is done by the ATAD module when a device is accepted by the software. So whenever you quit OPL and boot something else, the HDD will be issued the new settings again.

Good to know

To cut the chase, I was planning to try it out and debug it with the equipment I have. But only because I think it sticks out like a sore thumb.
The changes these few days have been very costly for me already though.

There's not hurry, it doesn't happen with all games (with many though '^^), for now I just disable the cache file when I plan to IGR from one of those games

Maybe it's all correlated, solving this maybe there wouldn't be even need for the Ferrari Challenge specific patch (maybe).

Here what I noticed doing some tests, I hope it will help you:

OPNPS2LD-GAMELIST-4 (as the 3 previous) can't read the games.bin file (it goes into an infinite loading loop and you need to hard shutoff your Ps2) after IGR from specific games (like Ferrari challenge, Ace Combat the unsung war, etc...). the bug Always occur, but only if the IGR path is set to OPL.

Well, actually I don't tried to setting the path to something else, therefore it is more accurate to say (for now) that setting the IGR path to <not set> the bug didn't occur.

This way I IGR (from Ace Combat) having the FMCB E1 Auto set to OPL, and the bug didn't occur (OPL perfectly load the list every time).
I IGR (Always with path <not set>), then gone to Ule (with R1 E1 hotkey), started OPL and the bug didn't occur.

So it remains to find out if the bug occur when IGResetting to OPL or when setting whatever path (so would need the IGR path to be <not set> to correctly work).

The USBHDFSD issue was fixed in late October. Which is why I have been telling everybody to throw away software made between June 8th and 27th October.

Well, at least it seems to be. I haven't had issues ever soon. But I usually don't use my PS2.

Then just yesterday or so, a 5-year old bug was found, which was causing poor performance. It should not affect data, however.

After all this years I'm fond of Ulaunchelf 4.42, it never gave me a problem. But I'll give it (the new Wle) a try

 

[Peppe90]

I'm only timing how long it takes for OPL to load. I start timing from after I launch the ELF and the video mode on my TV changes, I'm not including the console boot time.

How much time takes to display your list, counting from when the OPL loading icon appear??

 

[Tupakaveli]

How much time takes to display your list, counting from when the OPL loading icon appear??

I edited my previous post.

The loading icons don't appear on the logo for me because I load OPL in 1080i and have boot sound enabled. Under those conditions the loading icons are not shown because they appear to stall. It's related to the fadeDelay for the boot sound.

 

[Peppe90]

I edited my previous post.

The loading icons don't appear on the logo for me because I load OPL in 1080i and have boot sound enabled. Under those conditions the loading icons are not shown because they appear to stall. It's related to the fadeDelay for the boot sound.

Ah ok. I started counting from when the loading icon appears, so probably we have the same loading speed.

 

[Peppe90]

EDIT

 

[Tupakaveli]

After posting that I realised I should be testing with the boot sound disabled because it's adding an unnecessary 1.2 seconds of loading time lol.

 

[Krah]

This way I IGR (from Ace Combat) having the FMCB E1 Auto set to OPL, and the bug didn't occur (OPL perfectly load the list every time).
I IGR (Always with path <not set>), then gone to Ule (with R1 E1 hotkey), started OPL and the bug didn't occur.

So it remains to find out if the bug occur when IGResetting to OPL or when setting whatever path (so would need the IGR path to be <not set> to correctly work).

This has been a problem since the integration of IGR into OPL, it is recommended not to use the path to IGR directly back into OPL (something about code remaining active).

I don't think it's related to this game list cache feature.

 

[Peppe90]

This has been a problem since the integration of IGR into OPL, it is recommended not to use the path to IGR directly back into OPL (something about code remaining active).

I don't think it's related to this game list cache feature.

I knew about this recommendation,
However I could Always IGR to OPL from Ace Combat without problems since OPL 0.9.3. The problem happens only with the cache.
I mean, sure there's a bug (it's not caused by the cache function, it simply affect the cache function), but it doesn't cause any problem to OPL for scanning games (building the gamelist normally, as Always), it cause problem when reading the games.bin file though.

I Always IGR to OPL (since about 3 years), the only other problem about IGR I found, was using the Gamstar NA, IGResetting from State of Emergency, there was 90% chances for OPL to not building the list (it doesn't freezes though, simply shows a blank page), but it wasn't related to the IGR path (it happened IGResetting to anywhere) and this bug doesn't happen with the SONY NA.

In conclusion, IGResetting to OPL makes thing faster. Sure I'll follow your recommendation for now, but equally sure there's a bug which solving would (maybe) solve other related problems too.

 

[Peppe90]

For the new APPS feature, applications can be put within their own folders, within the APPS folders on each supported device. For example, on a USB disk:

APPS/
  LaunchELF/
    title.cfg
    BOOT.ELF
  SMS/
    title.cfg
    SMS.ELF

title.cfg only requires two lines for now. For example:

title=LaunchELF v4.50
boot=BOOT.ELF

I noticed it make an APPS folder in my USB HDD indeed (and supposedly to my iHDD too). What if I want to just keep using the old opl_cfg-app method?? I have all my APPS into the MC. (I tried launching Ulaunchelf and it started FMCB_Configurator…).

Or I need to put my apps into the iHDD by force?

 

[Tupakaveli]

Tested OPNPS2LD-GAMELIST-4.ELF

No issues. Loading times remain the same.

For the new APPS feature, applications can be put within their own folders, within the APPS folders on each supported device.

Personally I don't use the APPS page but I really like the idea of this.

 

[Peppe90]

Tested OPNPS2LD-GAMELIST-4.ELF

No issues. Loading times remain the same.



Personally I don't use the APPS page but I really like the idea of this.

View attachment 14316

So it will read my apps I have in my MC. But I can't set an app if it's not in the APPS folder, right?
i.e. I have FMCBconfigurator, other OPL version, etc... that aren't in apps folder. How should I do to show them in my APPS page without using the opl_apps.cfg file?

 

[sp193]

As I Always say I like the immediacy of consoles (FHDB with a full huge HDD is to slow fro my tastes to even boot the ps2)

Are you sure? There is no function for scanning the HDD at boot.
I know there's the Sony logo at boot, but the PS2 cannot do anything when the HDD is not ready.

Well, I'll make further tests, Thank you. Btw, I said well, this function works only when playing a game from iHDD? It won't work If I launch a USB game, right??

Yes, this is only for the HDD unit. If you use other modes, the HDD will just be switched off/set to IDLE state.

There's not hurry, it doesn't happen with all games (with many though '^^), for now I just disable the cache file when I plan to IGR from one of those games

Maybe it's all correlated, solving this maybe there wouldn't be even need for the Ferrari Challenge specific patch (maybe).

It is related to this:

I have found that our IGR implementation does not wipe user memory before booting the next ELF, which occasionally resulted in faulty behaviour.

Earlier today, it would only cause OPL to run very, very slowly on my SCPH-39006. Then when I tried to debug it on the DTL-T10000, it would not happen.

Since the CEX PS2 has no debugging capabilities and booting something else (including RDB) somehow always made the bug disappear, I had to craft a custom version of OPL with DECI2 capabilities built-in, so it became possible to look around. After the custom build was made, the list had no problems getting generated, but OPL would always crash when a game is booted, due to severe memory corruption.

Here what I noticed doing some tests, I hope it will help you:

I see, thanks.

I edited my previous post.

The loading icons don't appear on the logo for me because I load OPL in 1080i and have boot sound enabled. Under those conditions the loading icons are not shown because they appear to stall. It's related to the fadeDelay for the boot sound.

Do you have a theme? Maybe that is also the reason why it seems to be taking longer for you. But it's already good.

Tested OPNPS2LD-GAMELIST-4.ELF

No issues. Loading times remain the same.

Thanks.

By the way, did you notice if OPL (OPNPS2LD-GAMELIST-4) got a little faster with listing your games, without the game list cache? I changed the sequence of events, so I was hoping that things would be slightly faster because the HDD would not "have to travel across the world" twice. If not, then I guess the seeking didn't matter as much as I thought it would.

This has been a problem since the integration of IGR into OPL, it is recommended not to use the path to IGR directly back into OPL (something about code remaining active).

Indeed, the age-old bug is here to torment us again. But maybe, it will be slain for good this time.

By the way, the APPS feature should make it easier to use other software (like emulators) with OPL. No need for the user to know about device paths.

I noticed it make an APPS folder in my USB HDD indeed (and supposedly to my iHDD too). What if I want to just keep using the old opl_cfg-app method?? I have all my APPS into the MC. (I tried launching Ulaunchelf and it started FMCB_Configurator…).

Or I need to put my apps into the iHDD by force?

It is backwards compatible with whatever you have. Only the startup filename display got changed.

So it will read my apps I have in my MC. But I can't set an app if it's not in the APPS folder, right?
i.e. I have FMCBconfigurator, other OPL version, etc... that aren't in apps folder. How should I do to show them in my APPS page without using the opl_apps.cfg file?

Yes.

For the new APPS feature, applications can be put within their own folders, within the APPS folders on each supported device. For example, on a USB disk:

APPS/
  LaunchELF/
    title.cfg
    BOOT.ELF
  SMS/
    title.cfg
    SMS.ELF

title.cfg only requires two lines for now. For example:

title=LaunchELF v4.50
boot=BOOT.ELF

 

[Tupakaveli]

Do you have a theme? Maybe that is also the reason why it seems to be taking longer for you. But it's already good.

I'm using the default theme for testing. I'm happy with the loading times

Thanks.

By the way, did you notice if OPL (OPNPS2LD-GAMELIST-4) got a little faster with listing your games, without the game list cache? I changed the sequence of events, so I was hoping that things would be slightly faster because the HDD would not "have to travel across the world" twice. If not, then I guess the seeking didn't matter as much as I thought it would.

I didn't time it without the cache but I will do it later when I get home from work. (In about 12 hours or so lol).

 

[Peppe90]

By the way, the APPS feature should make it easier to use other software (like emulators) with OPL. No need for the user to know about device paths.

It is backwards compatible with whatever you have. Only the startup filename display got changed.

Yes.

So, if I understood correctly, I will not anymore be able to set any path for an APP (?) (I should even delete the opl_apps.cfg).

It seems to me a step backwards. I mean, the old way I was able to list any elf (from any position) I want in the APPS page and I need to do just one cfg file for all the apps. This new way I should have all my elf into the APPS folder.
IMHO It's a bit inconvenient (even not possible for some elfs like FMCB Configurator).

I'd like to have the choice to stay with the old method… Btw if there are precise reasons (for safety and so) to opt for this new method, I'll see to get used to it.

 

[sp193]

I'm using the default theme for testing. I'm happy with the loading times

Ah, I see. Thanks for the info.

I didn't time it without the cache but I will do it later when I get home from work. (In about 12 hours or so lol).

I'll appreciate that. But if you're busy, this can wait. I have been moving the more important commits to the other pull request.

So, if I understood correctly, I will not anymore be able to set any path for an APP (?) (I should even delete the opl_apps.cfg).

If you really want to use opl_apps.cfg, you can continue doing so.

It seems to me a step backwards. I mean, the old way I was able to list any elf (from any position) I want in the APPS page and I need to do just one cfg file for all the apps. This new way I should have all my elf into the APPS folder.
IMHO It's a bit inconvenient (even not possible for some elfs like FMCB Configurator).

How is it more inconvenient? You can skip out the step involving LaunchELF and requiring knowledge of the device paths. If you wanted to add a new APP, you had to:

1. Copy app to the desired storage place. If it's not on media accessible by the PC, you need to boot your PS2 and use LaunchELF.
   
2. Use LaunchELF to edit opl_apps.cfg. Or copy it to the PC, edit it and put it back.
3. If any errors were made (OPL does not indicate such errors), repeat (2).

 

[Tupakaveli]

I tested OPNPS2LD-GAMELIST-4 multiple times with Cache Game List - Off.

It seems to be maybe 3 - 4 seconds slower compared to OPNPS2LD-GAMELIST-3 generating a new games.bin.

 

[sp193]

I tested OPNPS2LD-GAMELIST-4 multiple times with Cache Game List - Off.

It seems to be maybe 3 - 4 seconds slower compared to OPNPS2LD-GAMELIST-3 generating a new games.bin.

Am I understanding you correctly? Are you saying that it now only takes something like only 15 seconds, for processing 1000 partitions? If so, then the value of caching HDD titles like that, is very much diminished and perhaps we can consider letting OPL manage the game list on its own (like for USB devices & SMB shares), rather than requiring the user to manually refresh the game list whenever a game is added/removed.

Thanks for your help, by the way.

 

[Tupakaveli]

Sorry, my phrasing probably wasn't the best.

With OPNPS2LD-GAMELIST-4 and Cache Game List - Off, OPL takes ~55 seconds to load.

I wanted to test it against OPNPS2LD-GAMELIST-3 but it doesn't have the option to disable Cache Game List so I just made it generate a new games.bin which takes ~51 seconds.

With both ELFs reading the games.bin it takes ~12 seconds to load OPL.

These times are all with the HDD spun up.

Thanks for your help, by the way.

No problem, it's fun playing with new things

 

[Peppe90]

If you really want to use opl_apps.cfg, you can continue doing so...

...How is it more inconvenient? You can skip out the step involving LaunchELF and requiring knowledge of the device paths. If you wanted to add a new APP, you had to:

1. Copy app to the desired storage place. If it's not on media accessible by the PC, you need to boot your PS2 and use LaunchELF.
   
2. Use LaunchELF to edit opl_apps.cfg. Or copy it to the PC, edit it and put it back.
3. If any errors were made (OPL does not indicate such errors), repeat (2).

You mean that I can keep using opl_apps.cfg even with OPNPS2LD-GAMELIST-4??

Then what you think is causing the errors? I have all my apps correctly displayed on my apps page, but if I start i.e. Ulaunchelf, I end up in FMCB Configurator. I'll see if i can figure out why.

I tested OPNPS2LD-GAMELIST-4 multiple times with Cache Game List - Off.

It seems to be maybe 3 - 4 seconds slower compared to OPNPS2LD-GAMELIST-3 generating a new games.bin.

I confirm, it seems to take a little more time to build the list (for me, with 400 games, just about a second slower).

 

[sp193]

Sorry, my phrasing probably wasn't the best.

With OPNPS2LD-GAMELIST-4 and Cache Game List - Off, OPL takes ~55 seconds to load.

I wanted to test it against OPNPS2LD-GAMELIST-3 but it doesn't have the option to disable Cache Game List so I just made it generate a new games.bin which takes ~51 seconds.

With both ELFs reading the games.bin it takes ~12 seconds to load OPL.

These times are all with the HDD spun up.

Aww. I derped quite hard as well anyway, somehow not reading what you wrote correctly. @_@
I should take a break from this. I'm also getting frustrated with the problem that my own software are having with Japanese rendering, as I don't know what's wrong and do not know what to look at.

No problem, it's fun playing with new things

Thanks for your help!

So for now, I shall try to see whether the other game patch can be completed before that pull request is issued, followed by this set of changes.

You mean that I can keep using opl_apps.cfg even with OPNPS2LD-GAMELIST-4??

By design, you can.

Then what you think is causing the errors? I have all my apps correctly displayed on my apps page, but if I start i.e. Ulaunchelf, I end up in FMCB Configurator. I'll see if i can figure out why.

So are you saying that it does not work? It is possible that it does not work because my testing has been very limited, as I am already starting to spend whole days on these.

I confirm, it seems to take a little more time to build the list (for me, with 400 games, just about a second slower).

I see, noted with thanks.