Editing PlayStation archive (PSARC)
Jump to navigation
Jump to search
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
=Description= | =Description= | ||
'''P'''lay'''S'''tation '''ARC'''hive is a | '''P'''lay'''S'''tation '''ARC'''hive is a container that allows subfolders and per-file compression using Zlib or lzma with 9 compression levels | ||
*Notes: | |||
**lzma with compression level 9 has a compression ratio of around 50% of the size for general files | |||
**some files doesnt admits much compression like .BIK videos (max compression ratio for .BIK doesnt reachs 1% or 2%). For this reason is better to dont use compression with videos because the size reduction is ridiculous | |||
=Structure= | =Structure= | ||
See | See {{Talk}} page | ||
==Header== | ==Header== | ||
PSARC header example: | PSARC header example: | ||
'''Offset(h) 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F''' | '''Offset(h) 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F''' | ||
00000000 <span style="background:#ff6666;">50 53 41 52</span> <span style="background:#66ff66;">00 01 00 04</span> <span style="background:#ffff66;">7A 6C 69 62</span> <span style="background:#6666ff;">00 01 23 BA</span> | 00000000 <span style="background:#ff6666;">50 53 41 52</span> <span style="background:#66ff66;">00 01 00 04</span> <span style="background:#ffff66;">7A 6C 69 62</span> <span style="background:#6666ff;">00 01 23 BA</span> PSAR....zlib..#º | ||
00000010 <span style="background:#dd00dd;">00 00 00 1E</span> <span style="background:#dddd00;">00 00 09 16</span> <span style="background:#dddddd;">00 01 00 00</span> <span style="background:#d0000d;">00 00 00 02</span> ................ | 00000010 <span style="background:#dd00dd;">00 00 00 1E</span> <span style="background:#dddd00;">00 00 09 16</span> <span style="background:#dddddd;">00 01 00 00</span> <span style="background:#d0000d;">00 00 00 02</span> ................ | ||
Line 32: | Line 19: | ||
! Offset !! Size !! Name !! Example !! Value (conversion) !! Notes | ! Offset !! Size !! Name !! Example !! Value (conversion) !! Notes | ||
|+PSARC Header | |+PSARC Header | ||
| style="background-color:#ff6666;" | 0x00 || style="background-color:#ff6666;" | 0x04 || '''magic''' || 50 53 41 52 || PSAR || '''P'''lay'''S'''tation ''' | | style="background-color:#ff6666;" | 0x00 || style="background-color:#ff6666;" | 0x04 || '''magic''' || 50 53 41 52 || PSAR || '''P'''lay'''S'''tation '''Ar'''chive | ||
|- | |- | ||
| style="background-color:#66ff66;" | 0x04 || style="background-color:#66ff66;" | 0x04 || '''version''' || 00 01 00 04 || v1.4 || First 2 bytes is the | | style="background-color:#66ff66;" | 0x04 || style="background-color:#66ff66;" | 0x04 || '''version''' || 00 01 00 04 || v1.4 || First 2 bytes is the main version, next 2 bytes is the subversion and are processed separatedlly, so 0001.0004 is "translated" to 1.4 by the system | ||
|- | |- | ||
| style="background-color:#ffff66;" | 0x08 || style="background-color:#ffff66;" | 0x04 || ''' | | style="background-color:#ffff66;" | 0x08 || style="background-color:#ffff66;" | 0x04 || '''compression type''' || 7A 6C 69 62 || zlib || zlib (default) or lzma | ||
|- | |- | ||
| style="background-color:#6666ff;" | 0x0C || style="background-color:#6666ff;" | 0x04 || ''' | | style="background-color:#6666ff;" | 0x0C || style="background-color:#6666ff;" | 0x04 || '''table of content length''' || 00 01 23 BA || 0x123BA || | ||
|- | |- | ||
| style="background-color:#dd00dd;" | 0x10 || style="background-color:#dd00dd;" | 0x04 || ''' | | style="background-color:#dd00dd;" | 0x10 || style="background-color:#dd00dd;" | 0x04 || '''table of content entries size''' || 00 00 00 1E || 30 Bytes || Default is 30 bytes | ||
|- | |- | ||
| style="background-color:#dddd00;" | 0x14 || style="background-color:#dddd00;" | 0x04 || ''' | | style="background-color:#dddd00;" | 0x14 || style="background-color:#dddd00;" | 0x04 || '''number of entries''' || 00 00 09 16 || 1+2325 files || The filecount includes the "file path/names definitions" as an additionall file always placed at first position in the list and without an assigned ID | ||
|- | |- | ||
| style="background-color:#dddddd;" | 0x18 || style="background-color:#dddddd;" | 0x04 || ''' | | style="background-color:#dddddd;" | 0x18 || style="background-color:#dddddd;" | 0x04 || '''block size''' || 00 01 00 00 || 65536 Bytes || Default is 65536 Bytes | ||
|- | |- | ||
| style="background-color:#d0000d;" | 0x1C || style="background-color:#d0000d;" | 0x04 || ''' | | style="background-color:#d0000d;" | 0x1C || style="background-color:#d0000d;" | 0x04 || '''archive flags''' || 00 00 00 02 || Absolute paths || Default is 0. See table below | ||
|} | |} | ||
PSARC Archive Flags are stored in the header as a big endian number, and defines the characteristics and structure of the archive when it was created | |||
{| class="wikitable" | {| class="wikitable" | ||
|+PSARC Archive Flags | |||
! Hexadecimal<br />(big endian) !! Decimal !! Binary<br />(flags) !! Flag Name !! Notes | |||
|- | |- | ||
| {{cellcolors|black|lime}} 00 00 00 00 || style="text-align:right;" | 0 || 00000000 00000000 00000000 00000000 || '''relative archive paths''' (no slash character at the start of every line) || default value when using command line or xml | |||
| | |||
| | |||
|- | |- | ||
| | | {{cellcolors|black|lime}} 00 00 00 01 || style="text-align:right;" | 1 || 00000000 00000000 00000000 00000001 || '''ignorecase archive paths''' (all characters in capitals) || same than --ignorecase in command line and ignorecase="true" in the xml | ||
|- | |- | ||
| | | {{cellcolors|black|lime}} 00 00 00 02 || style="text-align:right;" | 2 || 00000000 00000000 00000000 00000010 || '''absolute archive paths''' (slash character added at the start of every line) || same than --absolute in command line and absolute="true" in xml | ||
|} | |} | ||
==TOC Table== | |||
==Blocks info table== | ==Blocks info table== | ||
==File table== | ==File table== | ||
The compression is applyed "per-block", is posible to know the compression level by looking at the zlib header | The compression is applyed "per-block", is posible to know the compression level by looking at the zlib header | ||
<small> | |||
{{Zlib Header}} | |||
</small> | |||
=PSARC Tools= | =PSARC Tools= | ||
Line 118: | Line 63: | ||
GUI versions are derivated from the command line versions | GUI versions are derivated from the command line versions | ||
==Open PSARC PS3 Extractor== | ==Command line versions== | ||
===Open PSARC PS3 Extractor=== | |||
By Matthieu Milan. It allows you to extract PSARC archive data in linux | By Matthieu Milan. It allows you to extract PSARC archive data in linux | ||
Source code: https://www.ferb.fr/ps3/PSARC/ | Source code: https://www.ferb.fr/ps3/PSARC/ | ||
==PSARC tool== | ===PSARC tool=== | ||
Port of Matthieu Milan's open PSARC PS3 extractor to Windows. Tool written by Matthieu Milan (@usineur). Ported to VS2012 by AlexAltea. | Port of Matthieu Milan's open PSARC PS3 extractor to Windows. Tool written by Matthieu Milan (@usineur). Ported to VS2012 by AlexAltea. | ||
Line 136: | Line 82: | ||
-e START END Extracts files with the file id specified by the range between START and END (inclusive). | -e START END Extracts files with the file id specified by the range between START and END (inclusive). | ||
==PSARC Extractor== | ===PSARC Extractor=== | ||
By Insomniac @ xentax forums, download link: http://www.ps3hax.net/downloads.php?do=file&id=452 and http://www.modcontrol.com/Board/pc-tools/28869-psarc-ps3-extractor.html | |||
By Insomniac @ xentax forums, download link: | |||
'''Usage:''' | '''Usage:''' | ||
Line 163: | Line 108: | ||
3 | 3,30 KB | /my/files/dummies/dummy3.bin | 3 | 3,30 KB | /my/files/dummies/dummy3.bin | ||
==PSARC== | ===PSARC=== | ||
1.60.008 SDK : x | 1.60.008 SDK : x | ||
1.92.001 SDK : x | 1.92.001 SDK : x | ||
Line 174: | Line 118: | ||
4.50.001 SDK : psarc-1310.001 (C++), built on Nov 16 2011 at 03:31:36 | 4.50.001 SDK : psarc-1310.001 (C++), built on Nov 16 2011 at 03:31:36 | ||
*From xentax forums: http://forum.xentax.com/viewtopic.php?p=44228&sid=0a7b5167ba4599f71f85471119c918a6#p44228 Download link: | *From xentax forums: http://forum.xentax.com/viewtopic.php?p=44228&sid=0a7b5167ba4599f71f85471119c918a6#p44228 | ||
*Download link: http://www.mediafire.com/?o3wy35uublreh | |||
=== | *Help | ||
'''usage:''' | |||
psarc verb [options] [file...] | |||
psarc --xml=XMLFILE | |||
'''verbs:''' | |||
create Create an archive. (default) | |||
extract Extract contents of an existing archive. | |||
list List contents of an existing archive. | |||
dump Print detailed info about archive for unit testing. | |||
verify Verify an existing archive's structural integrity and ensure that all files can be decompressed. | |||
dtd Display a DTD describing psarc's XML input syntax. | |||
'''general options:''' | |||
-h, --help Show this help message and exit. | |||
--version Display version and exit. | |||
-d, --debug Debug: Show debug messages. | |||
-v, --verbose Verbose: Show additional progress. (default) | |||
-q, --quiet Quiet: Don't show any progress. | |||
-y, --overwrite Overwrite existing files when creating/extracting. | |||
--xml=XMLFILE XML list of actions to perform. | |||
'''create options:''' | |||
-oFILE, --output=FILE Archive filename to create. | |||
-IINPUTFILE, --inputfile=INPUTFILE Inputfile listing files to archive. Consider --xml instead, which gives you more control. | |||
-m, --mself Create a PSARC-MSELF hybrid file for PS3, which can contain encrypted special files like SDATA, SPRX, and SPU SELF. | |||
--zlib Use Zlib when compressing. (default) | |||
--lzma Use LZMA when compressing. (usually for PS3 PSN) | |||
--level=N Compression quality. 1 is fastest, 9 is best. (default = 9) | |||
-N, --nocompress Store all files uncompressed in the archive. | |||
-bBS, --blocksize=BS Use blocks of size BS. (default = 64KiB) | |||
-jJOBS, --jobs=JOBS Compression threads to run at a time. (default = number of CPUs) | |||
-sREGEX, --strip=REGEX Perl-compatible regex specifying a prefix to strip from the pathnames stored in the archive. This may be specified more than once. (default = current dir) | |||
-S, --strip-all Strip all paths from files stored in the archive. | |||
-a, --absolute Make the paths within the archive absolute. | |||
-R, --relative Make the paths within the archive relative. (default) | |||
-i, --ignorecase Make the archive directory case-insensitive. | |||
--exclude=WILDCARD Wildcard specifying files to exclude. | |||
--skip-missing-files If set then ignore it when a file cannot be found. | |||
--mergedups Compare the content of all files, and merge identical files so that only one copy of the data is included. | |||
'''extract options:''' | |||
--input=FILE Archive to extract files from. (default is first file argument) | |||
--to=DIRECTORY Directory to write extracted files to. (default is current directory) | |||
--blocksize is in bytes. | |||
====verify==== | |||
{{Keyboard|content= | |||
C:\Portables\psarc>psarc.exe verify c:\psarctests\custom_folders.psarc | |||
Verifying c:\psarctests\custom_folders.psarc | |||
Validating 1: Folder1/Image1.bmp (6220854 bytes) | |||
Validating 2: Folder2/Folder21/Image21.png (6142 bytes) | |||
Validating 3: Folder3/Folder31/Folder311/Image311.jpg (12524 bytes) | |||
Archive OK | |||
}} | |||
{| class="wikitable" | |||
|+verify output per-file | |||
|| Validating <file ID/number>: || file path inside psarc archive || (file original size in bytes) | |||
|} | |||
====list==== | |||
{{Keyboard|content= | |||
C:\Portables\psarc>psarc.exe list c:\psarctests\custom_folders.psarc | |||
Listing c:\psarctests\custom_folders.psarc | |||
Folder1/Image1.bmp (6220854/6220854 100%) | |||
Folder2/Folder21/Image21.png (157/6142 2%) | |||
Folder3/Folder31/Folder311/Image311.jpg (209/12524 1%) | |||
}} | |||
{| class="wikitable" | |||
|+list output per-file | |||
|| file path inside psarc archive || (file compressed size || file original size || compression percentage) | |||
|} | |||
*Notes: | |||
**In the compression percentage: 100% is no reduction, 0% is a huge reduction | |||
=== | ====dump==== | ||
{{Keyboard|content= | |||
C:\Portables\psarc>psarc.exe dump c:\psarctests\custom_folders.psarc | |||
Dumping c:\psarctests\custom_folders.psarc | |||
Folder1/Image1.bmp os=6220854 cs=6220854 fb=2 | |||
Folder2/Folder21/Image21.png os=6142 cs=157 fb=97 | |||
Folder3/Folder31/Folder311/Image311.jpg os=12524 cs=209 fb=98 | |||
}} | |||
{| class="wikitable" | |||
|+dump output per-file | |||
|| file path inside psarc archive || file original size || file compressed size || file block start offset ? | |||
|} | |||
====dtd==== | |||
The output of this command is a layout that defines the structure of an .xml document. See: http://www.w3schools.com/DTD/ | The output of this command is a layout that defines the structure of an .xml document. See: http://www.w3schools.com/DTD/ | ||
*DTD Notes: | *DTD Notes: | ||
**Elements are defined in the DTD as: '''<!ELEMENT element-name (element-content)>''' | **Elements are defined in the DTD as: '''<!ELEMENT element-name (element-content)>''' | ||
Line 292: | Line 218: | ||
**Required attributes are defined with: '''#REQUIRED''', and optional attributes with: '''#IMPLIED''' | **Required attributes are defined with: '''#REQUIRED''', and optional attributes with: '''#IMPLIED''' | ||
<!ELEMENT psarc (create|extract)+> | |||
<!ELEMENT create (compression|strip|exclude|file|directory|filelist)+> | |||
<!ATTLIST create archive CDATA #IMPLIED | |||
absolute (true|false) "false" | |||
ignorecase (true|false) "false" | |||
mergedups (true|false) "false" | |||
stripall (true|false) "false" | |||
blocksize CDATA "65536" | |||
jobs CDATA #IMPLIED | |||
skipmissingfiles (true|false) "false" | |||
format (psarc|psarc-mself) "psarc" | |||
overwrite (true|false) "false"> | |||
<!ELEMENT compression EMPTY> | |||
<!ATTLIST compression type (zlib|lzma) "zlib" | |||
level (1|2|3|4|5|6|7|8|9) "9" | |||
enabled (true|false) "true"> | |||
<!ELEMENT strip EMPTY> | |||
<!ATTLIST strip regex CDATA #REQUIRED> | |||
<!ELEMENT exclude EMPTY> | |||
<!ATTLIST exclude regex CDATA #IMPLIED | |||
wildcard CDATA #IMPLIED> | |||
<!ELEMENT file (CDATA)> | |||
<!ATTLIST file wildcard CDATA #IMPLIED | |||
regex CDATA #IMPLIED | |||
path CDATA #IMPLIED | |||
archivepath CDATA #IMPLIED | |||
fromarchive CDATA #IMPLIED | |||
compressed (true|false) #IMPLIED | |||
skipifmissing (true|false) #IMPLIED> | |||
<!ELEMENT filelist EMPTY> | |||
<!ATTLIST filelist path CDATA #REQUIRED> | |||
<!ELEMENT directory EMPTY> | |||
<!ATTLIST directory path CDATA #REQUIRED | |||
archivepath CDATA #IMPLIED | |||
fromarchive CDATA #IMPLIED | |||
compressed (true|false) #IMPLIED | |||
skipifmissing (true|false) #IMPLIED> | |||
<!ELEMENT extract (file)+> | |||
<!ATTLIST extract archive CDATA #IMPLIED | |||
input CDATA #IMPLIED | |||
to CDATA #IMPLIED | |||
stripall (true|false) "false" | |||
skipmissingfiles (true|false) "false" | |||
overwrite (true|false) "false"> | |||
Based in the DTD layout is posible to create an .xml layout that automatizes all the actions of the tool, this example is a generic layout containing all the elements and attributes availables together | |||
{{Boxcode|content=<syntaxhighlight lang="xml"> | |||
{{Boxcode| | <?xml version="1.0" encoding="UTF-8"?> | ||
<psarc> | <psarc> | ||
<create archive="" absolute="false" ignorecase="false" mergedups="false" stripall="false" blocksize="65536" jobs="" skipmissingfiles="false" format="psarc" overwrite="false"> | <create archive="" absolute="false" ignorecase="false" mergedups="false" stripall="false" blocksize="65536" jobs="" skipmissingfiles="false" format="psarc" overwrite="false"> | ||
Line 312: | Line 288: | ||
</extract> | </extract> | ||
</psarc> | </psarc> | ||
</syntaxhighlight>}} | </syntaxhighlight>}} | ||
*Notes: | |||
**The purpose of this XML is to use it as a base layout containing all, but is not posible to use it like that, is needed to delete the tags that are not needed for a specific case, the ones that are incompatibles with other tags, and is needed to add paths, etc... | |||
**Some attributes appears as common in the DTD for "create" and "extract" but are not common, some of them has been deleted to avoid mistakes... but probably is needed to delete some more | |||
**Is posible to generate this kind of .xml by using as the source the output of the "list" command after applying over it some character strings replacing using regular expressions with a tool like http://findandreplace.codeplex.com/# | |||
* | |||
==Total Commander plugin== | ==Total Commander plugin== | ||
http://www.totalcmd.net/plugring/PSARC.html | http://www.totalcmd.net/plugring/PSARC.html | ||
==PS3 PSARC GUI== | ==GUI versions== | ||
===PS3 PSARC GUI=== | |||
It's a graphical user interface to view, extract or create psarc archives. GUI written by aldo, unknown psarc tool used internally | It's a graphical user interface to view, extract or create psarc archives. GUI written by aldo, unknown psarc tool used internally | ||
Download link: http://aldostools.org/ps3_psarc_gui.rar | Download link: http://aldostools.org/ps3_psarc_gui.rar | ||
=Games or Apps using PSARC files= | =Games or Apps using PSARC files= | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
! colspan=" | ! colspan="3" | External information !! colspan="5" | PSARC Header info !! rowspan="2" | Notes | ||
|- | |- | ||
! TITLE !! | ! Platform !! TITLE_ID !! TITLE !! Version<BR />(offset 0x04) !! Compression<BR />(offset 0x08) !! TOC entry size<BR />(offset 0x10) !! Block Size<BR />(offset 0x18) !! Flags<BR />(offset 0x1C) | ||
|- | |- | ||
| | | {{icon content ps3}} || || Ape Escape || 00010004 || Zlib || 0000001E || 00010000 || 00000002 || uses full paths (created with --absolute) | ||
|- | |- | ||
| | | {{icon content ps3}} || || Atelier Rorona Plus || 00010004 || zlib || 0000001E || 00010000 || 00000002 || | ||
|- | |- | ||
| | | {{icon content ps3}} || || God of War. Ascension || 00010004 || zlib || 0000001E || 00010000 || 00000002 || | ||
|- | |- | ||
| | | {{icon content ps3}} || || Killzone 3 || 00010004 || zlib || 0000001E || 00010000 || 00000001 || | ||
|- | |- | ||
| | | {{icon content ps3}} || || Mass Effect 3 || 00010004 || lzma || 0000001E || 00010000 || 00000003 || AUDIO.PSARC created with: --lzma --nocompress --absolute --ignorecase<br />MAIN.PSARC created with: --lzma --absolute --ignorecase | ||
|- | |- | ||
| | | {{icon content ps3}} || || Motorstorm. Pacific Rift || || || || || || | ||
|- | |- | ||
| | | {{icon content ps3}} || || Ni No Kuni || || || || || || .psarc file extensions renamed to .adat | ||
|- | |- | ||
| | | {{icon content ps3}} || || The Last Of Us || 00010003 || zlib || 0000001E || 00010000 || 00000000 || the game can load files from decompressed psarcs (because the original psarcs doesnt uses flags) | ||
|- | |- | ||
| | | {{icon content ps3}} || || Uncharted 2 || 00010003 || zlib || 0000001E || 00010000 || 00000000 || the game can load files from decompressed psarcs (because the original psarcs doesnt uses flags) | ||
|- | |- | ||
| | | {{icon content ps3}} || || Warhawk || || || || || || | ||
|- | |- | ||
| {{icon content ps4}} || || VidZone || 00010004 || zlib || 0000001E || 00010000 || 00000000 || | |||
| | |||
| | |||
| VidZone | |||
|} | |} | ||
*Other games that probably uses PSARC's | *Other games that probably uses PSARC's | ||
**Uncharted 1? | **Uncharted 1?, and 3? | ||
**Killzone colletion ? | **Killzone colletion ? | ||
**God of War. III ? | |||
**God of War. Collection ? | **God of War. Collection ? | ||
**other Motorstorms ? | **other Motorstorms ? | ||
*Rebuild notes: | |||
**Mass effect 3 MAIN.PSARC contains a folder with generic files (compressed with level 9) and another folder with .BIK videos (not compressed at all). In the creation options suggested above in the table the compression level is not defined and this means all them will use the default compression level 9 (so the .BIK files will have an 1% or 2% of compression ratio). This is not how the original file was created (but works), it seems there is a way to define specific compression levels "per file" or "per folder" (by using a DTD.XML filelist?) | |||
{{File Formats}} | {{File Formats}} | ||
<noinclude> | <noinclude>[[Category:Main]]</noinclude> | ||
[[Category:Main]] | |||
</noinclude> |