PS3 Archiving my library of PSN games

[Berion]

I didn't dump any games for ages so I don't remember how options are named (BTW I also used mM). If from optical disc, result is "dev_hdd0/PS3ISO/<game name>.iso", then You have decrypted disc image. If a result is "dev_hdd0/games/<game name>/" then it is garbage (copied files and folder from disc, old method, can be used but You loosing LBA order, playing from it is stressful for console, compatibility lower, some games needs additional hacks and due to unstable FTP servers, hard to send without reconnecting and retransferring).

Use Apollo SaveData Tool for import/export licenses from/to USB.

- - -
Yes, it is fine. Both using the same ODT standards. I will send You via private message the file.

 

[Rissy]

I didn't dump any games for ages so I don't remember how options are named (BTW I also used mM). If from optical disc, result is "dev_hdd0/PS3ISO/<game name>.iso", then You have decrypted disc image. If a result is "dev_hdd0/games/<game name>/" then it is garbage (copied files and folder from disc, old method, can be used but You loosing LBA order, playing from it is stressful for console, compatibility lower, some games needs additional hacks and due to unstable FTP servers, hard to send without reconnecting and retransferring).

Use Apollo SaveData Tool for import/export licenses from/to USB.

- - -
Yes, it is fine. Both using the same ODT standards. I will send You via private message the file.

Thanks for making that clearer. The games on the 2503 CFW HDD do indeed seem to have been put into the PS3ISO folder and are called <game>.ISO. There does seem to be other files associated with the games too. Like <game>.png image files and <game>.cue

Under the GAME folder, there are a bunch of folders called "BCES#####" which seems to be the game update/patch folders/files for each game I've updated over the internet.

I'm not sure about the contents of any other folder. I'd need help identifying anything else and what needs doing.

Can you show me this Apollo SaveData Tool? Where do I get that? Is this something installed on PS3 or PC, and what does it do?

I've now collected all my PS Store content from the PSN on my 2103 console. Sometimes files are so small that you can't be quick enough to select "download in background", so those files have been installed. For the larger files, they have been downloaded in "bubble" looking format on the XMB. I presume these are package files while they look like bubbles.

Can you advise me what I should do with all these PS Store download items? Install them, or leave them as packages? Before I convert the console to CFW readying myself to extract all of this off this console so I can put them on to my 2503 console to join them with all my games etc there.


Sent from my iPhone using Tapatalk

 

[Berion]

There does seem to be other files associated with the games too. Like <game>.png image files and <game>.cue

You don't need them to backup. Auto-generated by WMM.

Under the GAME folder, there are a bunch of folders called "BCES#####" which seems to be the game update/patch folders/files for each game I've updated over the internet.

Not "GAME" but "game". UFS2 like any *nix fs, is case sensitive.

As I said, there is patch + game cache.

I'm not sure about the contents of any other folder. I'd need help identifying anything else and what needs doing.

It is enough to read my tutorial. ;]

Can you show me this Apollo SaveData Tool? Where do I get that? Is this something installed on PS3 or PC, and what does it do?

https://github.com/bucanero/apollo-ps3

For the larger files, they have been downloaded in "bubble" looking format on the XMB. I presume these are package files while they look like bubbles.

Bubbles are packages, not yet unpacked. Decide if You want archive *.pkg or unpacked.

 

[Rissy]

You don't need them to backup. Auto-generated by WMM.

What is WMM?

Not "GAME" but "game". UFS2 like any *nix fs, is case sensitive.

As I said, there is patch + game cache.


It is enough to read my tutorial. ;]

Let me clarify tonight with a picture. I'm a bit confused still.

https://github.com/bucanero/apollo-ps3

Excellent, thank you! See, without these links, I'd never be able to find such things!? I don't know how you guys know about all these things all over the internet without hear-say...!?

Reading about this, this program, it seems to be for save files and trophies and the like, but not actual games. Once i transfer my games and game updates/patches from one console to the other, do i not need to do something with those to make them work on a different console too?

Bubbles are packages, not yet unpacked. Decide if You want archive *.pkg or unpacked.

How am I to decide? What is best? If they are packages, then you have a choice, but once they are unpacked, then you can't repack them again.....or can you? As for transferring them to another console, like with my question above, do you have to do something to them to allow them to work on a different console from the one they were originally downloaded to in the first place. Remember, on my 2503, I will not be logged on with my cherished account the same as i was when i downloaded them to my 2103. I think what I'm getting at is: "Is it easier to resign packages, or unpacked games? and is it even necessary?"

 

[Berion]

WebMAN Mod

Excellent, thank you! See, without these links, I'd never be able to find such things!? I don't know how you guys know about all these things all over the internet without hear-say...!?

It is magic.
Eventually You need to born with so called high functioning autism. But be careful what You wish for.

Reading about this, this program, it seems to be for save files and trophies and the like, but not actual games. Once i transfer my games and game updates/patches from one console to the other, do i not need to do something with those to make them work on a different console too?

I said that You need export licenses by this app on a hacked console and import it on also hacked console. If You have dump licenses in encrypted form in any way (e.g via file manager on PC), then you need decrypt them on Your own (for that You need IDPS and act.dat which encrypted them in the first place). I never said anything about saves or trophies backup/restore by this app. This feature is for people which want change ownership of saves and/or trophies. If both accounts (let's say one from source console and one from target console) using the same NP Account ID, You don't need resigning anything. As You can find in tutorial, it is enough to copy-paste data and rebuild database to appear in XMB.

How am I to decide?

You need to turn on "/dev/brain0" and "/dev/brain1".

What is best? If they are packages, then you have a choice, but once they are unpacked, then you can't repack them again.....or can you? As for transferring them to another console, like with my question above, do you have to do something to them to allow them to work on a different console from the one they were originally downloaded to in the first place. Remember, on my 2503, I will not be logged on with my cherished account the same as i was when i downloaded them to my 2103. I think what I'm getting at is: "Is it easier to resign packages, or unpacked games? and is it even necessary?"

It is You who deciding what is best for You. Many people prefer packages of everything. I prefer to unpacked form because packed cannot be efficiency archiving, wasting space and user time.

I think You still not get it. *.pkg on PS3 is delivery format. ONLY. Consider it as eg. *.zip on PC, the one with password protected and from which nothing can be run. Whatever it is a game from PSS (PlayStation Store ;]), patch, DLC, theme etc. It is downloaded as PKG, wrapped to be bubble and then unpacking, after that PKG deleting.

If You planning to share data with other people on the planet, keep original PKGs. If for personal use only, those packages is pain the ass. IMO. There is no reason to repacking PKGs or packing unpacked packages. Packages aren't signed per user but per keyset, so there is no need to resign packages.

As You can find in my tutorial called "Ultimate UserData Backup" (or according to filename: "PS3 Manual Backup"), You need to copy chosen "folder/file" and restore it in the same place on target console, plus rebuild database. If content is secured by NPDRM, then in addition, restore its license.

If Your content is in PKG form, You must install it from USB via "Install Packages" option. If Your content is unpacked, then You restoring it via FTP client (eg. FileZilla; but FTP servers are unstable on PS3) or USB (via file manager, eg. build-in in multiMAN) or HDD connected to PC.

 

[Rissy]

I didn't use WebManMOD to produce the ISO files. I used Multiman (mmCM). I didn't realise WebManMOD did that sort of thing too. I presume you meant Muiltiman, or they both do the same thing.

I'll get back to you tonight with some photos to illustrate what i am seeing. I'll look at your guide again too. Oh and i'll install Apollo and take a look at that too. (so much to learn about!)

You can tell me "correct" or "incorrect", but I'm presuming:

1. I can leave everything as packages on console #1 before I convert to CFW.
2. I can then take packages off console #1 and transplant over to console #2
3. I can still unpackage these packages on console #2 without issue.....?

This way I'd then be able to keep both the package version of content, AND the unpackaged versions.

All this is just for myself. I'm not giving anything to anyone else. I don't know anyone who'd be interested anyway. This is all purely for me.

Right here is some images capturing what I have, and I've used a game called HAZE, as a direct example.

This is what my hdd0 looks like:

When I go into GAME, this is what I see. Take note of BLES00157:

If I go into BLES00157, I see this:

This must be HAZE downloaded update data of some sort. If I open the ICON.png, I see this:

Because, if I navigate to PS3ISO, I see this:

This is where the main HAZE ISO disc image is saved.

I also found what seems to be the HAZE save game and trophy type data:

So is this all what you'd expect to see?

Have I been doing it all "correctly"?

Once I transfer my others consoles PSN data over to join this lot, I'll be starting to investigate licence changing stuff.


Sent from my iPhone using Tapatalk

I've just installed Apollo Save Tools. Had a look inside it, and this looks most helpful! Not tried anything with it yet, but looks promising. I might need some guidance as to what some of the menu options mean though!

While I'm here, this is a folder I discussed some time ago in another thread. What is this folder? When I click on it, I get an error:

Sent from my iPhone using Tapatalk

 

[Berion]

I didn't use WebManMOD to produce the ISO files.

It cannot make disc images, and I didn't said that can. What I said, those additional files are made by WMM (*.cue is for PSX games, icon is extracted from image).

You can tell me "correct" or "incorrect", but I'm presuming:

1. I can leave everything as packages on console #1 before I convert to CFW.
2. I can then take packages off console #1 and transplant over to console #2
3. I can still unpackage these packages on console #2 without issue.....?

PS3 will unpack bobbles on her own if I remember correct. But if not, then yes, You can leave that if You want archive only/also *.pkg.

Yes - for all 3 points.

This way I'd then be able to keep both the package version of content, AND the unpackaged versions.

Yes, but that's waste of space.

I don't know anyone who'd be interested anyway. This is all purely for me.

If Sony will delete it in future, like some games already, then probably everyone who want that game.

Right here is some images capturing what I have, and I've used a game called HAZE, as a direct example.

But You have in my guide all paths listed. So just read it and grab the stuff You want from pointed locations. It is not quantum mechanics.

Have I been doing it all "correctly"?

Yes. Except, You cannot mixed trophies from one console/account with another.

What is this folder? When I click on it, I get an error:

It is not folder. In XMB there are no folders, just abstracts.

Probably renamed "/App Home" and I believe I answered to that in the past (but maybe it wasn't You, don't remember now ;]). Useless for You anyway.

 

[Rissy]

PS3 will unpack bobbles on her own if I remember correct. But if not, then yes, You can leave that if You want archive only/also *.pkg.

The PS3 defintely wants you to unpack them. When you go to shutdown the console, it tries to make you finish unpacking them before turning off, but luckily you can override this and select "shutdown now". I'm just not sure what it will react like when it comes to attempting to do a firmware flash with them still there as packages in this state...?

But You have in my guide all paths listed. So just read it and grab the stuff You want from pointed locations. It is not quantum mechanics.

Yes. Except, You cannot mixed trophies from one console/account with another.

Thank you for your patience, you're definitely to be commended for that! I've read through your guide again, and yes you're right, I seem to be on the right path. I was planning on grabbing the trophies from Console #1 once converted to CFW and copying these over to Console #2. I thought I could use Apollo Save Tool to convert saves and trophies to the new host login on Console #2??? I thought I saw that option last night when taking a look at it...? Am I wrong?

Currently, console #1 is activated with Sony (I had to do this to be able to collect my PS Store packages). Do I want to leave it activated before making it CFW, or do I want to deactivate it beforehand? (I think Apollo allows you to activate it again by the looks of it last night!? Am I correct?)

I'll be in a position with time on my hands to hopefully convert console #1 into CFW ready to copy everything over to console #2 on Thursday. Before I do though, can I ask if there is any way for me to convert console #1 to CFW which doesn't require me to have that console connected to the internet in the same way as PS3ToolSet requires you to be able to access the webpage.
It's a pity this PS3ToolSet doesn't come in file format where you can install it on to a memory stick, meaning you don't need an internet connection.
I only ask because I'd prefer this conversion to remain unseen by Sony because for me it will only be a temporary thing once I've copied the necessaries off the machine, and collected the IDPS and EID Root Key. After this, I will put it back to OFW again, as I already have console #2 as a CFW machine. Since I've had my cherished account logged on to console #1 too, I don't want any chance of either the console or my cherished account being banned by Sony through visibility or them knowing what I've done!

You have my continued appreciation for your ongoing patience with me. I'm getting there, so not long now hopefully.

 

[Berion]

I never tried updating fw while having bobbles, so I dunno. There is no brick risk but high probably she will unpack them.

You can move trophies all at once. You cannot add trophies to existing ones, which means as I said, You cannot mixing trophies from one console and/or account and another.

If You on both consoles, have accounts with the same NP Account IDs, You don't need to resigning anything... If You will activate account by Apollo, You will get random NP Account ID, not existent in SEN, maybe even Apollo overwrite existing one, I dunno.

You don't need internet connection for anything except access to bgtoolset to patch fw, allowing by that CFW installation.

 

[Rissy]

I've literally just finished converting this console to CFW.

As far as the package bubbles go, it seems to have moved them to here:

And here (not sure what all this is to be honest)

I'm not sure how you install packages on CFW, as the bubbled packages no longer appear on the XMB!?
It still shows installed packages though.

These are all photos from console #1. I still need to copy PS Store content over to console #2. I'm planning on doing that next. I presume I just copy everything I can find on console #1 into the same directory on console #2 first of all?


Sent from my iPhone using Tapatalk

 

[Berion]

As far as the package bubbles go, it seems to have moved them to here:

They wasn't moved but unpacked there.

And here (not sure what all this is to be honest)

Those are licenses, tied to this specific console and this specific SEN user. Without them, your games, dlc, etc. will not work.

I'm not sure how you install packages on CFW, as the bubbled packages no longer appear on the XMB!?

Via option in XMB called "★ Install Packages" or "★ Package Manager". Seeks "dev_usb000/" and "dev_hdd0/packages".

I presume I just copy everything I can find on console #1 into the same directory on console #2 first of all?

Yes.
And if You want do that, You don't need those packages.

 

[Rissy]

I've found even more stuff. This is clearly related to package bubbles too. Not sure about any of this stuff.

I'm wondering now if I should have unpacked all this stuff before converting to CFW now. There's stuff all over the place I'm going to have to copy. To be fair though, the game "need for speed rivals" and "journey" were downloaded from PSN and these were also installed, and it's not clear how these are stored on the HDD, or where?!

I also found what appears to be metadata:

Sent from my iPhone using Tapatalk

So now I'm confused.

I put an Ethernet cable between console #1 and my laptop. I sent a manual IP address on the console, and did the same at my laptop.

I connected to the PS3 using FileZilla and this initially worked and allowed me to see the contents of the PS3. I started copying over some data, and initially this started working. Then all of a sudden it started failing. Now even after rebooting the PS3 I cannot get connected to it again. I get this message at FileZilla:

"ECONNREFUSED - Connection refused by server.

I can still ping it though.

What's happened here then? Why am I now being blocked by the PS3?!


Sent from my iPhone using Tapatalk

 

[Berion]

All paths where Your stuff is, has been described and mentioned in the tutorial. Everything else which is not mentioned, is garbage, pointless to backup.

Well, with one addendum worth to add to mentioned guide are bubbles. Actually I forgot about them (everything else than PKG in per bubble folder is garbage for XMB displaying, not needed).

dev_hdd0/vsh/game_pkg/<id>/*.pkg

BTW: From 3.55 times I remember that bubble stuff was in task dir.

"ECONNREFUSED - Connection refused by server.
What's happened here then? Why am I now being blocked by the PS3?!

https://www.psx-place.com/threads/archiving-my-library-of-psn-games.43761/page-2#post-390000

 

[Rissy]

If you look at this screenshot, you'll see what was queued in FileZilla to be copied over before my communications was cut (why was it cut!?). These are quite sizeable files in some cases. Are you sure this is garbage? It looks to me that this is the uninstalled packages.

I'm using Apollo now. Currently i've got it set to extract my trophies, but it's been going for about 30 mins now. Is that normal? How much disc space do i need for all this stuff? Currently i have about 8GB of space on the memory stick i have in there right now. I have no idea how much i need. What happens if the memory stick gets full to 100%? Will Apollo crash out, or advise me?

I've shutdown Apollo. It never finished exporting trophies. I'm not sure how long it would have taken, or how much data there would have been. I do have some trophy content on the memory stick that seems to have exported before i abandoned it (about 32MB worth exported). I'll have to take a look at the actual trophy folder to properly gauge the full size i guess. I'd like to understand how to get my FileZilla connection working again as without it, I'm going to have to use a USB HDD, and that will take a LONG time to copy all the games (packages and installed) by comparison. I've no idea why my connection was terminated and now I can't get it back. Can you advise me why please?

 

[Berion]

FTP servers are unstable. Once connection be drop, You must re-connect and resend data on which has hanged, because on PC side will be left broken. If re-connection not helps, do PS3 reboot (at least soft one). Try sending small portions of data (I mean: in amonut of files, not in size).

Yes, *.pdb and ICON_FILE are garbage.
Packages aren't uninstalling but deleting, once their purpose been fulfilled. Along to them, all "bubble data".

I dunno. I using Apollo only for licenses import/export and saves resigning. I copying games and other stuff on PC, directly from PS3 HDD. FTP or USB is huge waste of time for me.

 

[Rissy]

FTP servers are unstable. Once connection be drop, You must re-connect and resend data on which has hanged, because on PC side will be left broken. If re-connection not helps, do PS3 reboot (at least soft one). Try sending small portions of data (I mean: in amonut of files, not in size).

I'll maybe try again, and take it more slowly, but I did try rebooting the PS3 etc and nothing worked to bring it back...

Yes, *.pdb and ICON_FILE are garbage.
Packages aren't uninstalling but deleting, once their purpose been fulfilled. Along to them, all "bubble data".

I'm not sure i get you. I'd like to just get everything copied over, then install the packages and see what i'm left with in the end. Then I'll know for sure, and perhaps understand.

I dunno. I using Apollo only for licenses import/export and saves resigning. I copying games and other stuff on PC, directly from PS3 HDD. FTP or USB is huge waste of time for me.

I'll maybe try again, but it seems to take a long time and doesn't give you any feedback to the screen of what it's doing, so you're left wondering if it's crashed or not...!

I'd take the HDD out of the PS3 and put it into my caddy and read off it directly, but it's encrypted isn't it? I now have the EID Root Key, but i don't know what to do with it....?

 

[Charles_n_town]

I can understand your situation. I'm all digital on the switch. I've never hacked my system, so I downloaded only games I own, just in case I'm locked out of them, which I think is more likely with Nintendo than Sony imo. anyway, there's always a risk with cfw. if you get banned, you'll lose access to those games as Sony bans both account and system most of the time. Nintendo only bans systems when it comes to detecting cfw afaik. be very careful if you decide to go through with it.

 

[zecoxao]

if it's possible for the owner of this machine to submit the rifs act.dat and idps combo for analysis, it'd be greatly apreciated. a friend and i are trying to find collisions in the ecdsa signature of the rifs and act.dat, which could lead to your own signed rifs/act.dat

 

[zecoxao]

also do not use ftp to transfer such a large collection of games. make a backup of the hdd and dump the root key instead, then copy them from one disc to the other using berion's tools

 

[Rissy]

I can understand your situation. I'm all digital on the switch. I've never hacked my system, so I downloaded only games I own, just in case I'm locked out of them, which I think is more likely with Nintendo than Sony imo. anyway, there's always a risk with cfw. if you get banned, you'll lose access to those games as Sony bans both account and system most of the time. Nintendo only bans systems when it comes to detecting cfw afaik. be very careful if you decide to go through with it.

I've gone through with it, and I hope I'm being careful. My I ntention now is to keep my internet connection completely separate from this console while it's on CFW. My ongoing intention will be to take it back to OFW again, then completely remove the HDD and replace it with a brand new larger one which has never been used, then rebuild the console on that instead. By the time I'm done, I'm hoping all evidence of this console ever having CFW on it will be expunged. Can anyone tell me if this will be the case, or are there ALWAYS going to be some sort of trace elements left on the console chipset advising Sony it's been hacked at some point even if not at that time?

The only time they may have been able to tell anything is when I used PS3ToolSet to flash the chipset. As soon as that got done (even before rebooting), the internet was disconnected and it's been disconnected since.

To be ultra careful, I'll have no intention to ever login to my cherished account using that console, but I can test it with my disposable one instead.

I just hope nothing comes from continuing to use my clean consoles with my cherished account.

If I get banned, my cherished account trashed, and my consoles taken out, then that's the end of my PlayStation career. No point buying any more consoles, or games. I'll spend my money on motorbikes instead.


Sent from my iPhone using Tapatalk

also do not use ftp to transfer such a large collection of games. make a backup of the hdd and dump the root key instead, then copy them from one disc to the other using berion's tools

This is the bit I don't know about. I'm not bothered about backing up the HDD. I just want the data off it for transfer to my dedicated CFW machine.

I don't know what HDD tool of Berion's you're discussing. I have the EID Root Key and IDPS already. I hope I've got everything I need intact, as for me, this was a one shot deal. I'm not doing this again. So I hope I've got it right, and continue to do so until complete.


Sent from my iPhone using Tapatalk

if it's possible for the owner of this machine to submit the rifs act.dat and idps combo for analysis, it'd be greatly apreciated. a friend and i are trying to find collisions in the ecdsa signature of the rifs and act.dat, which could lead to your own signed rifs/act.dat

My understanding is I shouldn't be sharing these codes otherwise they can be used for spoofing and I would come to harm as a result.

I also don't know who you are. You've not helped me at any point through this little adventure of mine to get this far.


Sent from my iPhone using Tapatalk