Titan Network
Community => City of Heroes => Topic started by: Codewalker on May 03, 2019, 02:42:31 PM
-
Somebody asked me to make a thing, so I made a thing.
You'll need to run this from the command line, but hopefully if you've managed to set up either the dedicated or the VM image personal server, it shouldn't be too difficult.
Usage
As always back up your XML files before doing anything! This tool does not modify them, but it's strongly recommended to always have a good backup in case of accidental foot-shooting like switching the order of the input and output files.
xml2db [authid] [authname] [bin.pigg] [xmlfile] [txtfile]
authid: The ID number for the game account the character will go on. You can get this from the sql database. I think it's also possible to see it in-game by turning on self info with the GM commands.
authname: The name of the game account - same thing you type in on the login screen.
bin.pigg: Path to the I24 bin.pigg file.
xmlfile: Sentinel+ XML file to be converted.
txtfile: Output file to create.
Example:
xml2db 150 myaccount C:\I24\piggs\bin.pigg CoolGuy.xml CoolGuy.txt
Once you have the output file, you can use mapserver in dbquery mode to import it.
bin\dbquery.exe -putcharacter CoolGuy.txt
Download
https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0
Source
https://github.com/cwtitan/xml2db
To get this done quickly I reused my old libcoh library from back in the day. It was an experiment with C++/Boost (never again) and can be a rather large pain to compile from source.
Notes & Caveats
Sentinel+ only exported information that the client had access to, which means a lot of stuff is missing, especially state related to mission and contact completion. This tool attempt to correct some of the bigger issues related to accolade powers and inventory sizes, but it is far from comprehensive and there may be some slight irregularities, especially related to having badges for arcs that the game doesn't think you've completed yet.
All characters processed by this tool are granted the Passport badge.
-
You, sir, are an Elite Boss!
However....is it possible that you could draw up some instructions for the idiots to follow? Oh, not for me....asking for a friend.
Thanks!
-
However....is it possible that you could draw up some instructions for the idiots to follow?
Those are the instructions he already posted. It cannot be simplified any further.
-
Nice, unfortunately I don't have any dumps, I feel like I would have made them but only in recent years have I started storing more data "in the cloud" and old computers and hard drives are long gone so I doubt I'd find them.
I would be curious if Sentinel+ could be made to work on current "i25" servers / future servers, while we are still in unknown territory on what will happen it would be nice to know I could make a backup of any characters, sure it can be done on the server end but I can't imagine we'll see access to backing up features, though in theory it should just be a matter of allowing "/packageent" to be used on any access level, in other words 0, no clue if this takes a hit on the database or if your game instance is already holding all your data once you login.
-
-
Those are the instructions he already posted. It cannot be simplified any further.
This is where I get lost...
authid: The ID number for the game account the character will go on. You can get this from the sql database. I think it's also possible to see it in-game by turning on self info with the GM commands.
I don't know how to access the sql database nor do I know any of the GM commands to find the authid.
-
This is where I get lost...
I don't know how to access the sql database nor do I know any of the GM commands to find the authid.
Unless you are running your own server, you won't have access to the commands or the databases necessary.
You run the commands on the server, not in the client.
At least that's how my non-specialist brain is deciphering the instructions.
-
Somebody asked me to make a thing, so I made a thing.
Example:
xml2db 150 myaccount C:\I24\piggs\bin.pigg CoolGuy.xml CoolGuy.txt
Dies for me at LoadingBodyParts.bin. Well, actually it just gets stuck. Doesn't complete :P
Love the concept, but not working at the moment for me :(
-
For me, starts up, right after "Indexing powers.bin...", it gets Error: std::bad_alloc
Any thoughts?
-
Still getting
Error: std::bad_alloc
anyone have any luck with this?
Please let me know.
-
-
I asked a server operator about implementing this and one item they brought up was people altering an input XML file for personal gain (ie putting a few extra 0s in the Inf line). So what I am asking is are the exported XMLs protected from this ? Is the VKEY line at the very end a file hash or checksum ?
-
I asked a server operator about implementing this and one item they brought up was people altering an input XML file for personal gain (ie putting a few extra 0s in the Inf line). So what I am asking is are the exported XMLs protected from this ? Is the VKEY line at the very end a file hash or checksum ?
Yes. See post 19 here:
https://www.cohtitan.com/forum/index.php?topic=4890.msg44659#msg44659 (https://www.cohtitan.com/forum/index.php?topic=4890.msg44659#msg44659)
-
-
Somebody asked me to make a thing, so I made a thing.
You'll need to run this from the command line, but hopefully if you've managed to set up either the dedicated or the VM image personal server, it shouldn't be too difficult.
Usage
As always back up your XML files before doing anything! This tool does not modify them, but it's strongly recommended to always have a good backup in case of accidental foot-shooting like switching the order of the input and output files.
xml2db [authid] [authname] [bin.pigg] [xmlfile] [txtfile]
authid: The ID number for the game account the character will go on. You can get this from the sql database. I think it's also possible to see it in-game by turning on self info with the GM commands.
authname: The name of the game account - same thing you type in on the login screen.
bin.pigg: Path to the I24 bin.pigg file.
xmlfile: Sentinel+ XML file to be converted.
txtfile: Output file to create.
Example:
xml2db 150 myaccount C:\I24\piggs\bin.pigg CoolGuy.xml CoolGuy.txt
Once you have the output file, you can use mapserver in dbquery mode to import it.
bin\mapserver.exe -putcharacter CoolGuy.txt
Download
https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0
Source
https://github.com/cwtitan/xml2db
To get this done quickly I reused my old libcoh library from back in the day. It was an experiment with C++/Boost (never again) and can be a rather large pain to compile from source.
Notes & Caveats
Sentinel+ only exported information that the client had access to, which means a lot of stuff is missing, especially state related to mission and contact completion. This tool attempt to correct some of the bigger issues related to accolade powers and inventory sizes, but it is far from comprehensive and there may be some slight irregularities, especially related to having badges for arcs that the game doesn't think you've completed yet.
All characters processed by this tool are granted the Passport badge.
ah Codewalker, I cannot begin to thank you enough for this, however I do seem to be at a mild impasse and I hope or someone in the know can assist.
I seem able to make the output file but how does one run mapserver in dbquery mode for the import?
I'm probably missing something pretty basic and silly but it is late for me, plus medication.....oy.
Anyway, help would be appreciated. Thank you.
-
*
-
Open a command line in your server root folder (where the bin and data folders are) and, with your exported .txt on the same folder, run bin\dbquery.exe -putcharacter yourfile.txt
If you have multiple to import, use for %a in (*.txt) do bin\dbquery.exe -putcharacter %a
Still having trouble
-
Same here ..
I follow everything to the letter ..
When I enter in command line: bin\dbquery.exe -putcharacter yourfile.txt
I get a failed to connect to DbServer
I run it when server is up ..
I get a file not found ..
Am I missing something?
-
Same here ..
I follow everything to the letter ..
When I enter in command line: bin\dbquery.exe -putcharacter yourfile.txt
I get a failed to connect to DbServer
I run it when server is up ..
I get a file not found ..
Am I missing something?
1. You are supposed to run it when the server is up.
2. Is the file you're trying to load is actually named yourfile.txt, or did you follow the example without considering that part ?
-
Hi,
No, the file I am trying to load is mychractersname.txt .. so many of them ..
mychractersname.txt = any of my character's individual file names ..
-
Well, I got it to work finally ..
I Managed to import my saved toons to my private server ..
Issue was where the files were placed:
My server is located at "C:\CoH" .. call this the server root directory ..
I placed my character.txt files in the server root directory ..
Then point a command prompt in the server root folder: "C:\CoH"
Then at the prompt "bin\dbquery.exe -putcharacter character.txt"
The issue I was having is that I had put everything in the bin folder .. just not so clear in the wording .. but its working ..
THANK YOU TO ALL !! My toons are all home safe!!
-
Also .. one thing I should mention .. the converter is quite picky .. when the character information was originally extracted with Sentinel .. it looked something like this:
globalname.characterserver.character name.xml
Well, the converter doesnt like that .. so I just changed the file name so a simple one
name.xml (using with above example)
So all that was where my errors started .. I just made things really simple .. and all worked just fine!!
Thank you all once again!!
-
Also .. one thing I should mention .. the converter is quite picky .. when the character information was originally extracted with Sentinel .. it looked something like this:
globalname.characterserver.character name.xml
Well, the converter doesnt like that .. so I just changed the file name so a simple one
name.xml (using with above example)
So all that was where my errors started .. I just made things really simple .. and all worked just fine!!
Thank you all once again!!
I try to make the .txt file and get message error opening file. What am i missing?
-
Hey everyone, I managed to get it to work! I made a post about it here (https://www.reddit.com/r/Cityofheroes/comments/brtf0g/my_beloved_d3_defender_from_the_2012_shutdown/eogciaz/) , but the bottom line is that the last step with the import is missing a character:
Wrong
dbquery.exe -putcharacter [yourfile.txt]
YES!
dbquery.exe -putcharacter < [yourfile.txt]
(https://i.postimg.cc/CBp01C0r/screenshot-190521-17-05-38.jpg) (https://postimg.cc/CBp01C0r)
As proof, here's my beloved level 50 D3 on my private server :)
-
Hey everyone, I managed to get it to work! I made a post about it here (https://www.reddit.com/r/Cityofheroes/comments/brtf0g/my_beloved_d3_defender_from_the_2012_shutdown/eogciaz/) , but the bottom line is that the last step with the import is missing a character:
Wrong
dbquery.exe -putcharacter [yourfile.txt]
YES!
dbquery.exe -putcharacter < [yourfile.txt]
(https://i.postimg.cc/CBp01C0r/screenshot-190521-17-05-38.jpg) (https://postimg.cc/CBp01C0r)
As proof, here's my beloved level 50 D3 on my private server :)
Congrats on your success,
So what is the trick to making the convert to text work in the first place? I keep getting errors
-
Okay well now it seems to work, but it seems to stop on Loading Bodyparts.bin....
-
I think it might be due to using the wrong piggs files ..
Make sure you are using the ones from the Tequila install i24 .. if you are using i25 piggs it wont work ..
What I did is that I copied the piggs folder into the folder where my costume save are in .. like I mentioned, I found the converter very picky .. and I made the process as simple as possible ..
Hope this helps a little!! Good luck
-
Okay well now it seems to work, but it seems to stop on Loading Bodyparts.bin....
Does your character have more than one name? Is it an older character that the costume extract program also failed on?
I get the hangup with those two types.
Changing the name to a single word works, but still get errors about the body parts and it doesn't make a file. I have successfully created others.
-
So, now I'm creating the *.txt's ;D
But still running into this error
c:\coh>bin\dbquery.exe - putcharacter < [boneshaker.txt]
The system cannot find the file specified
Any idea on if there error is referencing my txt or debquery.exe?
-
My money's on the brackets. Take em off.
-
So on a slightly different tack, what is the probability of getting the original Sentinel+ extractors to work again ? I tried using SentinelBeta on 4 different servers and it could not detect the client, almost certainly because all the servers were i25 derived, and I don't know of any pure i24s out there currently.
Why do this?
1. To serve its original purpose again. If NCSoft goes all carpet bombing with C&Ds, the majority of servers will probably just disappear.
2. This is effectively the ultimate form of server transfer. If people don't like the community where they are playing, they could make a copy & start somewhere else assuming importation is an option. Or take their character on a server hopping tour. Alt-itis is fun and all but repeatedly having to make/re-make a "main" character would not be a good thing IMO.
-
I wouldn't even expect Sentinel+ to work on any I24 servers. When the game was live, the tool had to be recompiled every time the game was patched to update the memory offsets where it needed to read information from the client.
-
Does your character have more than one name? Is it an older character that the costume extract program also failed on?
I get the hangup with those two types.
Changing the name to a single word works, but still get errors about the body parts and it doesn't make a file. I have successfully created others.
Turned out the converter didn't like the file name for some screwy reason. There were no unusual characters in the xml file name of the character, it wasn't a hideously long name either, in fact I had a character back up with an even longer file/character name that did convert with no problem.
So after renaming the two files that kept hanging they converted....so now I have all of them converted to text files......
.....BUT THE IMPORT INTO THE SERVER STILL WONT WORK......
c:\coh\bin\dbquery.exe - putcharacter < characternamehere.txt
The system cannot find the file specified
please note the file name characternamehere.txt is a generic name for the purpose of posting here. I am using the correct file name :)
-
KK .. I will write what I did .. I did manage to import all my saved characters to my server...
My server directory is
C:\CoH (yours might be different)
I put all my character.txt files in E:\CoH
In console (cmd.exe) I pointed the directory to C:\CoH
then I ran the command line:
bin\dbquery.exe -putcharacter yourcharacter.txt
It worked like a charm .. hope this helps!
-
KK .. I will write what I did .. I did manage to import all my saved characters to my server...
My server directory is
C:\CoH (yours might be different)
I put all my character.txt files in E:\CoH
In console (cmd.exe) I pointed the directory to C:\CoH
then I ran the command line:
bin\dbquery.exe -putcharacter yourcharacter.txt
It worked like a charm .. hope this helps!
Before I attempt this, I need to take a rest. Too much job stress.
Edit: okay came back and attempted this again, this time the command prompt window showed this:
Starting: bin\dbquery.exe -putcharacter eternal.txt
Quitting: bin\dbquery.exe -putcharacter eternal.txt
So I would think that it worked, but I log in and......character is not there.
So presuming that IS what the cmd screen should show as a success.....now what is wrong?
I'm starting to think that what I think is the account ID number I took from the character info screen when I logged in as a testing character isnt the correct one.
So where in the SQL can I confirm the account ID number?
oh just great.....now the client on my PC now suddenly says cannot connect to DBserver.....yet I know it is running!
-
I took the information in the database .. do this:
Open Microsoft SQL Server Management Studio
Log into server
+ on Databases
+ on cohauth
+ on Tables
Right click on dbo.user_account
Edit Top 200 Rows
The information should be there for you
-
I took the information in the database .. do this:
Open Microsoft SQL Server Management Studio
Log into server
+ on Databases
+ on cohauth
+ on Tables
Right click on dbo.user_account
Edit Top 200 Rows
The information should be there for you
The fields all say Null
-
Hmmm .. if you have an account, it should show there ..
Have you created an account on your server yet?
Have you created a character on your server yet?
Might sound like a stupid question, but I have to ask ..
I have 2 accounts created on my server, and both servers appear there.
-
Hmmm .. if you have an account, it should show there ..
Have you created an account on your server yet?
Have you created a character on your server yet?
Might sound like a stupid question, but I have to ask ..
I have 2 accounts created on my server, and both servers appear there.
Logged in with the client on my PC, VMware/server running on same pf many times had two logins with a test toon on each
Now however after booting up could server in VMware like always and then going through all server activation steps and then opening game client, the game client now can no longer find or connect to the db server.
Yet if I run the game client on the server also it can connect
Plus I still can't restore my alts
So I am thinking now that there is a massive hex on this whole thing and am thinking of deleting the virtual server and installed freedom package then install freedom again from rar storage, make a new vm server and start over
And then maybe see if someone here who had done this would like to remote in via team viewer and guide me since it is clear I am missing something that I cannot see..
-
Well, the only thing I have used is Microsoft SQL Server Management Studio
The other thing that I was also made aware of, is that the server must be running in order to import the characters.
So other that what I've shared here, I really don't know why it isn't working on your end.
Last thing to share with you all, is that I found that sometimes the converter doesn't convert properly. I did double check the .txt files before I did the import and I did find that some of the files were empty. I had to use the ORIGINAL .xml files and create the .txt file from scratch. I don't know why, but if you get failures in converting the xml files to the txt files, it corrupts the xml file, so ALWAYS WORK FROM A BACKUP .. you don't want to loose your original xml character files ...
-
Well, the only thing I have used is Microsoft SQL Server Management Studio
The other thing that I was also made aware of, is that the server must be running in order to import the characters.
So other that what I've shared here, I really don't know why it isn't working on your end.
Last thing to share with you all, is that I found that sometimes the converter doesn't convert properly. I did double check the .txt files before I did the import and I did find that some of the files were empty. I had to use the ORIGINAL .xml files and create the .txt file from scratch. I don't know why, but if you get failures in converting the xml files to the txt files, it corrupts the xml file, so ALWAYS WORK FROM A BACKUP .. you don't want to loose your original xml character files ...
A suspicion flashes in my mind that perhaps the steps I located for creation of server and imports may be incomplete.
When you say create an account, do you mean just log in with the game client and make alts or is there a server command to run to create an account?
If it is the latter then I do not have that command and that would explain a few things
-
On your personal server, you need to create a came account ..
When I created mine, I used this web address:
cohstuff.dreamhosters.com/makeaccount.php
That is all I used .. assign an ID, assign a Login ..
If you don't create an account, the importer has no place to import your characters to.
-
On your personal server, you need to create a came account ..
When I created mine, I used this web address:
cohstuff.dreamhosters.com/makeaccount.php
That is all I used .. assign an ID, assign a Login ..
If you don't create an account, the importer has no place to import your characters to.
Interesting indeed, looks like I have something to do later
However without doing this it did let me log in and make test characters and mess around a bit with admin commands.....ghost account perhaps?
Well with luck I can do this and then my client outside the VMware will regain it's ability to connect to the dbase again.
Otherwise it is purge and reload from the rar backup.
-
You definitely need an account to import your characters to ..
-
You definitely need an account to import your characters to ..
Yeah I see now. The person that I obtained setup instructions didn't include the manual editing of SQL for the purpose of character restoration. The game started and connected and allowed an account to be used but I guess we'll call that a ghost.
In any event I deleted and restored the virt machine from backup. Once my head stops spinning from the medication I sadly still need (metformin) I can then sit down and start to edit the data and cross my fingers.
Question: for the dbp.user_auth where you input the password info, the file I generated from that site you listed (thank you for that! :) ) has CONVERT(BINARY(128) then the comma then the password string. Does the CONVERT(BINARY(128) go in as well or just the string?
Want to get this right the first time, :)
-
Update: okay the client on my PC now again talks to the vmware server after the refresh/reinstall.
copied one of the text files over, far as I can tell the SQL files have been edited and saved.
so I run the command for importing after bringing the coh server and mapserver online and get the following:
C:\>coh-i25\bin\dbquery.exe -putcharacter kheldian.txt
started 2019-05-30 15:34:11
detected QuickEdit, disabling...
Starting: coh-i25\bin\dbquery.exe -putcharacter kheldian.txt
Quitting: coh-i25\bin\dbquery.exe -putcharacter kheldian.txt
C:\>
The lack of a success message made me think something went wrong, so I go into my account and sure enough.....no import.
-
Did you put the right ID and account name?
According to what you posted, it should have imported.
-
Did you put the right ID and account name?
According to what you posted, it should have imported.
It looks like the account data i put in did not commit to the database.
SQL being a bit new to me, don't i just tell it to execute SQL ?
-
Well finally. Thanks to a kind soul who has my gratitude, my server is up and running and alts are restored!!!!!
Things that didn't get restored: free specs and tailor sessions, but server commands seem to have fixed that :)
Also was able to use commands to display and copy the ingame badge list, and salvage list.
It is nice to have my toons back. As to rebuilding them on the homecoming servers from scratch.....we'll see. Too busy badging with my reborn original alt.
-
Just wanted to post a quick thank you.
Last night I uploaded my favourite character to my i24 server. Which was lovely to see.
I can't remember how any of the incarnate stuff works though ;)
Still, great to know exactly where I had progressed.
I did get an error message running dbquery that said "WARNING: Didn't find match for costume part Standard, skin_head_03, none"
but it appears to have imported fine.
Cheers.
-
Somebody asked me to make a thing, so I made a thing.
You'll need to run this from the command line, but hopefully if you've managed to set up either the dedicated or the VM image personal server, it shouldn't be too difficult.
Usage As always back up your XML files before doing anything![/u] This tool does not modify them, but it's strongly recommended to always have a good backup in case of accidental foot-shooting like switching the order of the input and output files. xml2db [authid] [authname] [bin.pigg] [xmlfile] [txtfile]
authid: The ID number for the game account the character will go on. You can get this from the sql database. I think it's also possible to see it in-game by turning on self info with the GM commands.
authname: The name of the game account - same thing you type in on the login screen.
bin.pigg: Path to the I24 bin.pigg file.
xmlfile: Sentinel+ XML file to be converted.
txtfile: Output file to create.
https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0
(https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0)https://github.com/cwtitan/xml2db (https://github.com/cwtitan/xml2db)
To get this done quickly I reused my old libcoh library from back in the day. It was an experiment with C++/Boost (never again) and can be a rather large pain to compile from source.
Notes & Caveats
Sentinel+ only exported information that the client had access to, which means a lot of stuff is missing, especially state related to mission and contact completion. This tool attempt to correct some of the bigger issues related to accolade powers and inventory sizes, but it is far from comprehensive and there may be some slight irregularities, especially related to having badges for arcs that the game doesn't think you've completed yet.
All characters processed by this tool are granted the Passport badge.
-----------------------------------------------------------
I need some advice, please.
I tried downloading https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0 (https://www.dropbox.com/s/u5411ralpbnnjuu/xml2db.exe?dl=0) and https://github.com/cwtitan/xml2db (https://github.com/cwtitan/xml2db) : Tequila runs, COH login screen appears and I cannot log in. When I use to play COH in 2009, my account name was cowboy 2511. One of my characters was named DocArtz. For some reason DocArtz has all of the sudden become my sign in name instead of cowboy 2511. Does anyone have an idea how I can log in and play once again?
Thanks in advance and I hope to be in the game SOON!
Doc or EnChancer ???
-
If you're trying to log into Paragon Chat, we might be able to help.
If you're trying to log into the game servers that are up and running, we can't help with that because we aren't running any of those servers.
In either case, this thread isn't the place to ask for help with either one.
I would suggest starting a new thread or maybe asking for help on the forums where you want to play. (You'll have to create a new account there.)