Printable Version of Topic

Click here to view this topic in its original format

Forum 17B _ General discussion _ Find Out Which Wads Are In Effective Use By A Bsp

Posted by: eduardolucioac 07/10/2022 - 04:06:55

With the following command...

CODE
HLExtract.exe -p "fy_office.bsp" -e "root\fy_office.ent"


... is possible to find out which WAD files (textures) are listed as in use by a BSP (map) file as this output example ("fy_office.ent" file content extracted in the above command)...

CODE
{
"wad" "\programme\valve\valve\thwc_hl.wad;\programme\valve\cstrike\sourcebuero.wad;\programme\valve\cstrike\villaggio.wad;"
"mapversion" "220"
"MaxRange" "4096"
"skyname" "tornsky"
"classname" "worldspawn"
"classname" "worldspawn"
}
[...]


Notice that in the item "wad" several WAD files (textures) are listed. It turns out that none of these WAD files are needed even though they are listed. This happens with many BSP (map) files.

I've already tried several utilities and haven't found any that allow me to set this information correctly. I needed a utility that can be used via command line, as I need this output in text.

Is there any utility or strategy (via the command line) that I can use to correctly define this information, ie which WAD files (textures) are actually in use by a BSP (map) file?

Thanks! smiley-ipb-421-60dce7.gif

Posted by: LiveWire 07/10/2022 - 18:03:12

I can`t think of any, it might be worth asking on https://twhl.info/ in case someone there knows. Have a search though github as there`s lots of half-life / goldsrc tools on there.

Whats the reason to you need to do this?



Found this on https://github.com/kriswema/resgen

Do not ignore unused WAD files. Necessary if the client insists on receiving all WADs referenced by the BSP, even if unused. Only works if used with the -u option.

Parses relevant resource files to make sure they are actually used (such as WAD files) or to check if they have dependencies (such as MDL files with seperate textures). Only works with -e option.

Posted by: eduardolucioac 08/10/2022 - 02:09:45

This is an old question and the answer is simple, NO.

WHY? Because the BSP file does not have this information.

In reality, BSP files only have the list of WAD files it uses and the names of the textures, but it does not have information to which WAD file a particular texture belongs. The names of these textures are unique within a BSP.

---------------------------------------------------------------------------

The way GoldSrc (CS 1.6) works gives the false impression that it "knows" which WAD files are needed. But not quite...

To understand how GoldSrc (CS 1.6) works, let's imagine the following scenario: You have loaded a BSP file, but you have not made any of the referenced WAD files available...

CODE
[...]
"wad" "\programme\valve\valve\thwc_hl.wad;\programme\valve\cstrike\sourcebuero.wad;\programme\valve\cstrike\villaggio.wad;"
[...]


... in the "cstrike" or "valve" folders.

So, still within this scenario, let's imagine some more situations to demonstrate how GoldSrc (CS 1.6) would act when trying to load each of the textures pointed at in the BSP file:



---------------------------------------------------------------------------

PLUS: POSSIBLE SOLUTION (A LINUX APPROACH)

The only possible solution to programmatically determine (via BASH script, for example) which WAD files are needed is to export the list of textures from a WAD file with a utility like "HLExtract.exe"...

EXAMPLE

CODE
WINEDEBUG=-all wine "<PATH>/HLExtract.exe" -p "<PATH>\SOME_WAD.wad" -l | grep -i ".bmp" | cut -d\\ -f2 | cut -d. -f1 > "SOME_WAD_TEXTURES_LIST.txt"


... and based on the obtained list check each of the textures inside the BSP using a utility like "strings"...

EXAMPLE

CODE
strings "<PATH>/SOME_BSP.bsp" | grep -iw -- "SOME_TEXTURE_NAME" >> "SOME_BSP_TEXTURES_IN_USE.txt" 2>&1


... so that if located, then this WAD file is in use by the BSP file.

NOTES:



Thanks! smiley-ipb-421-60dce7.gif

Posted by: eduardolucioac 08/10/2022 - 02:13:30

QUOTE (LiveWire @ 07/10/2022 - 14:03:12) *
I can`t think of any, it might be worth asking on https://twhl.info/ in case someone there knows. Have a search though github as there`s lots of half-life / goldsrc tools on there.

Whats the reason to you need to do this?



Found this on https://github.com/kriswema/resgen

Do not ignore unused WAD files. Necessary if the client insists on receiving all WADs referenced by the BSP, even if unused. Only works if used with the -u option.

Parses relevant resource files to make sure they are actually used (such as WAD files) or to check if they have dependencies (such as MDL files with seperate textures). Only works with -e option.



RESGen does not work this way. This option gives us the false feeling that it has this ability.

Thanks! thank_you2.gifThanks!

Posted by: rUsHnUt 08/10/2022 - 16:20:27

I don't know if this is of any use but you can try by typing "developer 1" in console.
Then launch a map and check the console for the text "Using WAD File:".

Posted by: LiveWire 10/10/2022 - 23:22:33

QUOTE (eduardolucioac @ 08/10/2022 - 02:13:30) *
RESGen does not work this way. This option gives us the false feeling that it has this ability.

Thanks! thank_you2.gifThanks!



Hi, did you try that linked version of resgen? from the comments I would of thought it checks the wads.

https://hlbsp.sourceforge.net/index.php?content=bspdef


I used above link to make a bsp loader for unity, if you look at the texture lump string names are in BSPMIPTEX with the texture width and height, if the mipmap offsets are zero then it searches though the wad list in the bsp for them, if it can`t find the texture it uses a puple/black checkerboard.

As you said the wads in hammers list seem to be included even if they are not used, I`m not sure if this is still the case with recent compilers like vhlt umhlt.


Most of the c# coded needed to make a tool to check textures is in here

https://github.com/thelivewire/unityHalf-life

Posted by: mikado 11/10/2022 - 05:07:28

installe wally et tu pourras voir ce wad avec leur fichier

Posted by: LiveWire 11/10/2022 - 18:36:45

Looking at the code in resgenclass.cpp of that version of resgen it looks like it does check if wads are used.


QUOTE (eduardolucioac @ 08/10/2022 - 02:13:30) *
RESGen does not work this way. This option gives us the false feeling that it has this ability.

Thanks! thank_you2.gifThanks!


Posted by: LiveWire 11/10/2022 - 18:39:55

I think they want an easy way to do this to lots of BSP

QUOTE (mikado @ 11/10/2022 - 05:07:28) *
installe wally et tu pourras voir ce wad avec leur fichier


Posted by: eduardolucioac 11/10/2022 - 23:34:50

QUOTE (LiveWire @ 10/10/2022 - 19:22:33) *
Hi, did you try that linked version of resgen? from the comments I would of thought it checks the wads.

https://hlbsp.sourceforge.net/index.php?content=bspdef


I used above link to make a bsp loader for unity, if you look at the texture lump string names are in BSPMIPTEX with the texture width and height, if the mipmap offsets are zero then it searches though the wad list in the bsp for them, if it can`t find the texture it uses a puple/black checkerboard.

As you said the wads in hammers list seem to be included even if they are not used, I`m not sure if this is still the case with recent compilers like vhlt umhlt.


Most of the c# coded needed to make a tool to check textures is in here

https://github.com/thelivewire/unityHalf-life


QUOTE
I`m not sure if this is still the case


I can't say if you're right, but I can say with certainty what I wrote in these excerpts...

QUOTE
A BSP file can have its textures embedded in it so that it will not need the referenced WAD files;
A WAD file can have textures that have the same name as textures in another WAD file. The precedence of loaded textures is always by the last loaded WAD - the order followed is the same as the "wad" attribute which has the list of referenced WAD files. This can give the false impression that a WAD is not needed if a previous one already has textures with the same name, however this can result in the wrong textures being loaded.


QUOTE
Most of the c# coded needed to make a tool to check textures is in here


I found this information very useful, but unfortunately the code I am writing is not in C#. Thank you anyway. smiley-ipb-421-60dce7.gif

Posted by: eduardolucioac 11/10/2022 - 23:36:45

QUOTE (mikado @ 11/10/2022 - 01:07:28) *
installe wally et tu pourras voir ce wad avec leur fichier


QUOTE
Install wally and you can see this wad with their file.


Plase, write in English. smiley-ipb-421-60dce7.gif

Posted by: LiveWire 12/10/2022 - 12:05:10

https://github.com/kriswema/resgen


eduardolucioa looking at its source code the above version of resgen looks to do exacly what you need.



QUOTE (eduardolucioac @ 11/10/2022 - 23:34:50) *
I can't say if you're right, but I can say with certainty what I wrote in these excerpts...


I found this information very useful, but unfortunately the code I am writing is not in C#. Thank you anyway. smiley-ipb-421-60dce7.gif


Posted by: eduardolucioac 12/10/2022 - 20:21:14

QUOTE (LiveWire @ 12/10/2022 - 08:05:10) *
https://github.com/kriswema/resgen


eduardolucioa looking at its source code the above version of resgen looks to do exacly what you need.


I believe this is the option...

QUOTE
Added WAD file parsing. RESGen will now check if a WAD file actually contains textures used by the map. It also reports any missing textures. Use the -u switch to activate the checking.


... it basically does the same process (via "brute force") that I described. That is, a given WAD will be in use if the texture(s) has its name referenced within the WAD (as well as the WAD name itself). The determination of who is being used or not (WAD) is done through a cross-referencing of information.

IMPORTANT: The version that has this feature is 2.0.3 . We were unable to test this version.

Thanks! smiley-ipb-421-60dce7.gif

Posted by: LiveWire 12/10/2022 - 22:06:36

Just to muddy the water a little more wink.gif

A texture might already be in memory from previous maps and won`t be loaded at all.

There was a trend of retexturing maps by making new wads but keeping the old texure names, this caused textures to bleed from map to map with some weired results.


https://www.17buddies.rocks/17b2/View/Map/94541/dod_avalanche_remake.html
https://www.17buddies.rocks/17b2/View/Map/88652/dod_avalanche_urban.html
https://www.17buddies.rocks/17b2/View/Map/94528/dod_avalanche_orange.html
https://www.17buddies.rocks/17b2/View/Map/81680/dod_avalanche_aztec.html
https://www.17buddies.rocks/17b2/View/Map/362/dod_avalanche.html




Posted by: eduardolucioac 13/10/2022 - 02:42:50

QUOTE (LiveWire @ 12/10/2022 - 18:06:36) *
[...]
A texture might already be in memory from previous maps and won`t be loaded at all.

There was a trend of retexturing maps by making new wads but keeping the old texure names, this caused textures to bleed from map to map with some weired results.
[...]


Man, this is "loco"... It's true! These textures and other things tend to behave weirdly when we load several maps in sequence, including some referring to the "good" old "512 Precache Limit"... to_pick_ones_nose2.gif

Posted by: Chapo 14/10/2022 - 15:26:03

old.gif

Perhaps should you take a look at BSPFile class in https://forum.17buddies.rocks/index.php?showtopic=14329 source code ;-)

smiley-ipb-421-60dce7.gif

Powered by Invision Power Board (http://www.invisionboard.com)
© Invision Power Services (http://www.invisionpower.com)