[REL] mySH3-TooL_v1 small SH3 Mod-Helper Tool (this is not a Mod) - Page 5

propbeanie · 12-03-23, 05:09 PM

Quote:

Originally Posted by Hebe Vollmaus

*Bump*
Update to 2.1d

Renumber now accept EQP-file CargoDef.cfg DefSide.cfg Dials.cfg Locations.cfg

add mkDBs "DB_Dat.csv" info about near-Zero-sized 3D-objects, images, shadows, index
add Config DatNoZero3D= search will ignore named files (without Path and Extension)
add Config Max3DobjSize= search for limited variable Size 3D-objects
add Button [sns Check]

add ButtonMenu [Dat Del.All.Idx.2.NewMod]
Will create a Mod-Directory (JSGME ready) of all found Dat-files with index. The index will be deleted.
With this Mod you can test your install if there will be any time-difference on Load the Game for example into the Museum with and without an index in DAT-files.

Greetings.
Have fun!

Excellent news Hebe!!! Thank you very much

Kpt. Lehmann · 12-03-23, 06:09 PM

Thank you, Hebe. Good stuff.

itadriver · 12-04-23, 03:12 AM

Thank you

Hebe Vollmaus · 01-30-24, 02:25 PM

Hi All,
a very profound user has directed me to a Dat-file which crashes my Tool on makeDBs. I can reproduce this, and found the exact place where this ugly Bug is sitting and the reason why it is running wild.
The underlying reason is this: i create a buffer in memory and sometimes i read beyond the end of the buffer, which is not allowed. So the Operating-System gives a "NoGo!" with a 0xC0000005 "STATUS_ACCESS_VIOLATION".
A simple Programmer mistake.

What bugs me is as big fat this little thing is/was, why it it does not crash always and only on specific files. Hmm, lets see - comes time, comes knowlege.

What i like to say is - a bugfix is in progress.

propbeanie · 01-31-24, 09:36 AM

Thank you Hebe! Most excellent news. Looking forward to your edits, and I want to thank you again for this fine tool!

Anvar1061 · 01-31-24, 02:54 PM

@Hebe Vollmaus
We are waiting for a fix for the latest version, which actually crashes sometimes.

Hebe Vollmaus · 02-04-24, 05:46 AM

Bugfix need some time as i try to do also other things in it.

40+ GB of 10.300+ different SH-Dat-files on my HD needs around two and a halfe houre to scan.
Only 2 crash on a Release-buld. None in Debug-build.

Hebe Vollmaus · 02-08-24, 07:14 PM

*Bump*
Update to v2.1e

I dont want you stand still in the rain for that long. So here it is.

Bugfix #1 - makeDBs - Crash while scan Dat-files.

Bugfix #2 - delAllIdx2NewMod - Abort scan after found first Dat-file without index in a drawer. (Filenumber in Library was much too less.)
Added some Hints redirected into a file named "DB_idx.csv" when found mystic things as the lots of found ugly files are too much for a Screen-only Message when scan thousends of files. "Abort" here means the file is not copied, as it may be broken afterwards when deleting a index with a defect index-lenght.
You may be amused how many files can not read by S3D, or how many files have more then one Index, or the index is not on End of file.
And also here, there is no such mystic things in clean vanilla SH3v14.

Whats left are these non-ansi Filenames/Drawernames by Cyrillic alphabets writing people like in "War Elite Mod" (WEM). Blucher.dat, NCA_BlБcher, what means Blücher.dat. Heavy cruiser named after "von Blücher". 'Ü' umlaut written by 'Б' or other things like that. If you have some dirs/files named like this you get a Warning "File not found". These files are ignored. This is by Design for now.

Greetings.
Have fun.
--
550 Mods found (9 activated)

Hebe Vollmaus · 02-14-24, 01:51 PM

Some words about "==Sort order -- something after idx==".
Most of the files i have seen have this note added in "DB_idx.csv". This means what it says, there is something after the index. Sometimes the index is in the middle of the file, sometimes near the end.
But it can also mean that the index-header-lenght is broken, somewhat too short. You can see this in S3D as an Unknown Chunk on the end with unusual huge numbers on Type and Subtype. For example Type: -732102642, Subtype: 1799828.

In general all thouse files with these false index-header-lenght can be easily 'repaired' with a Hex-Editor. Naturally there are also other files which S3D will not read, not only those with index-problems.

Greetings.

propbeanie · 02-14-24, 04:04 PM

Oiy yeah!!! I know 2 modders that are VERY Happy!

Thank you very much Hebe Vollmaus!

Hebe Vollmaus · 04-28-24, 07:21 AM

*Bump*
Update to v2.2

The heavy changes are made under the hood.

o ProgressBar -- for long run functions
This Bar is File-based, which means it moves faster foreward on small files then as for big files.

o Threads -- for long run functions
To make newer Operating-Systems happy; "...not reponding" Window-title should be gone now. As a consequence Program can be EXIT inbetween long operations now for whatever reason.

o New ButtonMenu [No MatFile Check] under [ini menu1024* Renum]
Material-check can be de-activated.

o New ButtonMenu [Split ini for SH5edit] under [ini menu1024* Renum]
Creates a Directory called "_SH3-Menu_forSH5-ED" in the MODS-directory of JSGME in SH3-directory.
It will cut the menu_1024_768.ini into pieces. May helpful when try to load parts of SH3-menu.ini into SH5-MenuEditor.
With parts i really mean parts. Loading the whole created Dir will not work. Also all related TGAs may better convert to DDS, and also renamed in created files. The "Zone="-line is not injected. For converting TGAs i use "texconv.exe" out of DXsdk_oct2004.
You may compare your menu_1024_768.ini with original SH5; maybe some info needed was deleted by the Modder which created your SH3-menu.ini. Also you have to read Documentations/Posts here on Subsim for handling the SH5-MenuEditor. Without it may hard to get any results.

o change separate Changelog
The history has been growing to much over time, to put everything in one ReadMe.

Greetings.
Have fun.
--
555 Mods found (12 activated)

FUBAR295 · 04-28-24, 07:32 AM

Thanks Hebe!

Hebe Vollmaus · 05-18-24, 12:26 AM

[Bump]
Update to v2.2a

Personaly i was cured long ago from Updateritis; my tool currently not.

I must really not assume that all files in all modded SH3-installations around the globe will follow SH3-Filename conventions. In general Names like "Name.ext" (Name-Point-Extension) or for Museum "Name_en.log" are usually 'normal' Files. "Name" (without extension) or "Name.log" has crashed in v2.2. Bug fixed.
Maybe i should add a new Function to scan for crap^w'unusual' Files before all.

Also remarkable is that a Installation of the above typ may not have Cargo-Nodes on Type=102 ships.
So my tool first checks if any Type 102 has these nodes, and if not, the Campaigne-check will nolonger blame these 'CargoExt=-1', since the in-game-Crash will not happen then.

Some minor changes; please look into the History.

Greetings.
Have fun!
--
562 Mods found (100 activated)

12-03-23, 06:09 PM	#62
Kpt. Lehmann GWX Project Director Join Date: Jul 2005 Location: The Republic of Texas Posts: 6,887 Downloads: 117 Uploads: 0	Thank you, Hebe. Good stuff. __________________ www.thegreywolves.com All you need is good men. - Heinrich Lehmann-Willenbrock

01-30-24, 02:25 PM	#64
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	Crash Hi All, a very profound user has directed me to a Dat-file which crashes my Tool on makeDBs. I can reproduce this, and found the exact place where this ugly Bug is sitting and the reason why it is running wild. The underlying reason is this: i create a buffer in memory and sometimes i read beyond the end of the buffer, which is not allowed. So the Operating-System gives a "NoGo!" with a 0xC0000005 "STATUS_ACCESS_VIOLATION". A simple Programmer mistake. What bugs me is as big fat this little thing is/was, why it it does not crash always and only on specific files. Hmm, lets see - comes time, comes knowlege. What i like to say is - a bugfix is in progress.

01-31-24, 09:36 AM	#65
propbeanie CTD - it's not just a job Join Date: May 2016 Location: One hour from Music City USA! Posts: 9,911 Downloads: 444 Uploads: 2	Thank you Hebe! Most excellent news. Looking forward to your edits, and I want to thank you again for this fine tool! __________________ "...and bollocks to the naysayers" - Jimbuna

01-31-24, 02:54 PM	#66
Anvar1061 Ocean Warrior Join Date: May 2012 Location: In the sea, on land and above Posts: 3,395 Downloads: 860 Uploads: 0	@Hebe Vollmaus We are waiting for a fix for the latest version, which actually crashes sometimes. __________________

02-08-24, 07:14 PM	#68
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	2.1e Bump Update to v2.1e I dont want you stand still in the rain for that long. So here it is. Bugfix #1 - makeDBs - Crash while scan Dat-files. Bugfix #2 - delAllIdx2NewMod - Abort scan after found first Dat-file without index in a drawer. (Filenumber in Library was much too less.) Added some Hints redirected into a file named "DB_idx.csv" when found mystic things as the lots of found ugly files are too much for a Screen-only Message when scan thousends of files. "Abort" here means the file is not copied, as it may be broken afterwards when deleting a index with a defect index-lenght. You may be amused how many files can not read by S3D, or how many files have more then one Index, or the index is not on End of file. And also here, there is no such mystic things in clean vanilla SH3v14. Whats left are these non-ansi Filenames/Drawernames by Cyrillic alphabets writing people like in "War Elite Mod" (WEM). Blucher.dat, NCA_BlБcher, what means Blücher.dat. Heavy cruiser named after "von Blücher". 'Ü' umlaut written by 'Б' or other things like that. If you have some dirs/files named like this you get a Warning "File not found". These files are ignored. This is by Design for now. Greetings. Have fun. -- 550 Mods found (9 activated)

12-04-23, 03:12 AM	#63
itadriver Commander Join Date: Aug 2007 Location: Italia Venezia Posts: 465 Downloads: 228 Uploads: 0	Thank you

02-04-24, 05:46 AM	#67
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	Bugfix need some time as i try to do also other things in it. 40+ GB of 10.300+ different SH-Dat-files on my HD needs around two and a halfe houre to scan. Only 2 crash on a Release-buld. None in Debug-build.

02-14-24, 01:51 PM	#69
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	Some words about "==Sort order -- something after idx==". Most of the files i have seen have this note added in "DB_idx.csv". This means what it says, there is something after the index. Sometimes the index is in the middle of the file, sometimes near the end. But it can also mean that the index-header-lenght is broken, somewhat too short. You can see this in S3D as an Unknown Chunk on the end with unusual huge numbers on Type and Subtype. For example Type: -732102642, Subtype: 1799828. In general all thouse files with these false index-header-lenght can be easily 'repaired' with a Hex-Editor. Naturally there are also other files which S3D will not read, not only those with index-problems. Greetings.

02-14-24, 04:04 PM	#70
propbeanie CTD - it's not just a job Join Date: May 2016 Location: One hour from Music City USA! Posts: 9,911 Downloads: 444 Uploads: 2	Oiy yeah!!! I know 2 modders that are VERY Happy! Thank you very much Hebe Vollmaus! __________________ "...and bollocks to the naysayers" - Jimbuna

04-28-24, 07:21 AM	#71
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	Bump Update to v2.2 The heavy changes are made under the hood. o ProgressBar -- for long run functions This Bar is File-based, which means it moves faster foreward on small files then as for big files. o Threads -- for long run functions To make newer Operating-Systems happy; "...not reponding" Window-title should be gone now. As a consequence Program can be EXIT inbetween long operations now for whatever reason. o New ButtonMenu [No MatFile Check] under [ini menu1024* Renum] Material-check can be de-activated. o New ButtonMenu [Split ini for SH5edit] under [ini menu1024* Renum] Creates a Directory called "_SH3-Menu_forSH5-ED" in the MODS-directory of JSGME in SH3-directory. It will cut the menu_1024_768.ini into pieces. May helpful when try to load parts of SH3-menu.ini into SH5-MenuEditor. With parts i really mean parts. Loading the whole created Dir will not work. Also all related TGAs may better convert to DDS, and also renamed in created files. The "Zone="-line is not injected. For converting TGAs i use "texconv.exe" out of DXsdk_oct2004. You may compare your menu_1024_768.ini with original SH5; maybe some info needed was deleted by the Modder which created your SH3-menu.ini. Also you have to read Documentations/Posts here on Subsim for handling the SH5-MenuEditor. Without it may hard to get any results. o change separate Changelog The history has been growing to much over time, to put everything in one ReadMe. Greetings. Have fun. -- 555 Mods found (12 activated)

04-28-24, 07:32 AM	#72
FUBAR295 Krusty Krab Join Date: Mar 2002 Location: Decks awash in the North Atlantic Posts: 1,357 Downloads: 475 Uploads: 0	Thanks Hebe! __________________ Good judgment comes from experience. Unfortunately, the experience usually comes from bad judgment.

05-18-24, 12:26 AM	#73
Hebe Vollmaus Lieutenant Join Date: Jun 2010 Location: Germany Posts: 253 Downloads: 3 Uploads: 1	2.2a [Bump] Update to v2.2a Personaly i was cured long ago from Updateritis; my tool currently not. I must really not assume that all files in all modded SH3-installations around the globe will follow SH3-Filename conventions. In general Names like "Name.ext" (Name-Point-Extension) or for Museum "Name_en.log" are usually 'normal' Files. "Name" (without extension) or "Name.log" has crashed in v2.2. Bug fixed. Maybe i should add a new Function to scan for crap^w'unusual' Files before all. Also remarkable is that a Installation of the above typ may not have Cargo-Nodes on Type=102 ships. So my tool first checks if any Type 102 has these nodes, and if not, the Campaigne-check will nolonger blame these 'CargoExt=-1', since the in-game-Crash will not happen then. Some minor changes; please look into the History. Greetings. Have fun! -- 562 Mods found (100 activated)