Author Topic: Tomax's site temporarily down  (Read 9456 times)

TonyV

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 2,175
    • Paragon Wiki
Tomax's site temporarily down
« on: May 02, 2016, 02:42:26 PM »
Hey all, so here's the deal.  Last night in order to do some other nifty things, I upgraded our server.  As part of that process, I upgraded PHP from 5 to 7, which is a pretty major upgrade.  The thing is, though, when Red Tomax created the site, there were a whole bunch of things that were just about to be deprecated (mainly procedural database calls in deference to MySQLi and eventually PDO), and with the upgrade to 7, they've been officially removed from the language.

As a result, after the upgrade, Tomax's site broke pretty horribly.  I'm having to go through and recode every database call that the site makes, which is almost every file that the site uses.  I'm also taking the opportunity to audit the code and plug up some holes I've found to make it more stable, tight, and secure.

So Red Tomax's site is currently down, and probably will be for a day or two, with functionality incrementally returning after that.

Sorry for the inconvenience, but I promise, we will get it back up ASAP.

wufenstein

  • Underling
  • *
  • Posts: 5
Re: Tomax's site temporarily down
« Reply #1 on: May 25, 2016, 03:06:26 PM »
Any progress on this front? Or, and I suggest this because based on my experience with PHP 7 it sounds like it might be quite an ordeal to get the site up and running again, any chance of just making a database dump available for download?

Sekoia

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 1,828
Re: Tomax's site temporarily down
« Reply #2 on: May 26, 2016, 03:13:55 AM »
I believe the current plan is to extract just the City of Data portion from Tomax and bring it up to par with PHP7. We will get it back online eventually, it's just taking longer than expected.

The rest of Tomax (everything except City of Data) probably will not be restored. Its content was very outdated and Paragon Wiki covers it all better at this point.

Jeff Anderson

  • Boss
  • ****
  • Posts: 121
Re: Tomax's site temporarily down
« Reply #3 on: June 18, 2016, 04:26:01 AM »
Hi,

Just thought I would check in. I would like to use the data, and was wondering when it would be back up.

Thanks!

HeatSpike1

  • Boss
  • ****
  • Posts: 132
  • CoH Global: @HeatSpike1
Re: Tomax's site temporarily down
« Reply #4 on: July 20, 2016, 04:27:54 PM »
Thanks for working on it, hope you guys can get it back up and running for us soon!

Sekoia

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 1,828
Re: Tomax's site temporarily down
« Reply #5 on: July 21, 2016, 12:13:28 AM »
Tony hasn't had a chance to work on it any further, so for the time being, I reverted the Tomax site back to use the version that is on our older (not-upgraded) server. It may take up to 2 days for the DNS change to propagate.

Kawless

  • Minion
  • **
  • Posts: 23
Re: Tomax's site temporarily down
« Reply #6 on: July 22, 2016, 11:59:32 PM »
https://tomax.cohtitan.com/data/powers/
It asks me for a name and password and rejects the one I use for Titan Network.

Can this pretty please be fixed?

Sekoia

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 1,828
Re: Tomax's site temporarily down
« Reply #7 on: July 24, 2016, 11:40:15 AM »
Looks like it's just the https that has issues. You can access the site fine with http:

http://tomax.cohtitan.com/data/powers/

Tahquitz

  • Titan Moderator
  • Elite Boss
  • *****
  • Posts: 1,831
Re: Tomax's site temporarily down
« Reply #8 on: May 15, 2018, 01:41:53 AM »
Tomax's site is down until further notice effective today.

Release: Tomax offline - TonyV
"Work is love made visible." -- Khalil Gibran

Thunder Glove

  • Elite Boss
  • *****
  • Posts: 971
Re: Tomax's site temporarily down
« Reply #9 on: May 15, 2018, 10:55:17 AM »
You say that "almost all of this info is in the Paragon Wiki", but none of the info I actually used that site for is on the Wiki - the hard numbers behind the powers.  (I was just going to look up how Incarnate Judgement powers damage scaling worked, in fact, which is how I learned the site was down.  Yeah, I still like going to look at the numbers, even after all these years.  Usually when I get into a discussion on other forums about how powerful CoH characters really were compared to the tissue-paper weaklings in other MMOs)
« Last Edit: May 15, 2018, 11:01:01 AM by Thunder Glove »

Tahquitz

  • Titan Moderator
  • Elite Boss
  • *****
  • Posts: 1,831
Re: Tomax's site temporarily down
« Reply #10 on: May 16, 2018, 01:59:25 AM »
So you're a fan of the data dump plan I take it?
"Work is love made visible." -- Khalil Gibran

saipaman

  • Elite Boss
  • *****
  • Posts: 919
Re: Tomax's site temporarily down
« Reply #11 on: May 16, 2018, 05:23:46 AM »
I second the data dump plan.

Thunder Glove

  • Elite Boss
  • *****
  • Posts: 971
Re: Tomax's site temporarily down
« Reply #12 on: May 16, 2018, 03:40:19 PM »
I ... guess?  But "dump" makes it sound like it's just going to be a single document with all the numbers jumbled together, rather than a searchable organized set of pages.  Going to miss that.

saipaman

  • Elite Boss
  • *****
  • Posts: 919
Re: Tomax's site temporarily down
« Reply #13 on: May 16, 2018, 06:11:39 PM »
I'm hoping for something more elegant and refined.

mobbyg

  • Minion
  • **
  • Posts: 49
  • Ultra Knight Lives!!
Re: Tomax's site temporarily down
« Reply #14 on: May 16, 2018, 06:55:43 PM »
I grabbed what was up on the Wayback Machine. Comes to about 190MB

spectre1989

  • Minion
  • **
  • Posts: 38
Re: Tomax's site temporarily down
« Reply #15 on: August 29, 2018, 11:46:19 AM »
Is there any chance of getting a data dump?

themamboman

  • Lieutenant
  • ***
  • Posts: 56
Re: Tomax's site temporarily down
« Reply #16 on: September 17, 2018, 03:00:46 PM »
Any chance this will ever show up again? I looked into many snapshots on the web archive, but not every page was archived.

Would love to have this for posterity or if the SEGS guys ever get something finished.

spectre1989

  • Minion
  • **
  • Posts: 38
Re: Tomax's site temporarily down
« Reply #17 on: September 17, 2018, 03:15:25 PM »
Did this just include data that was in the various bin files which shipped with the game, or was it more than that?

Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #18 on: January 02, 2019, 08:54:43 PM »
Would it be possible to get a copy of the site provided or perhaps the site temporarily brought up again?
I've wrote a page scraper that can get the useful information / data from the pages for the Powers.
It then writes this out to JSON files.

I can then release these JSON files so everyone has their own copy.

I am currently pointing it at the Wayback Machine - but I have found a few powers that are not archived.
Eg: Dominator - Electric Cage etc

If anyone has a copy of Red Tomax City of Data Powers etc
Please let me know.

Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #19 on: January 02, 2019, 09:00:35 PM »
A sample of what the data looks like so far:
Note - I am still working on it to include more.
Eventually it will contain the Power Effects and the PVE Damage Scale image
(the image will be either base64 converted or hosted on something called IPFS (Interplanetary File System) - archiving it for all time.)

I can also add the data itself to the IPFS network, making it so no one has to host it.
(Also - If we had an html version of the original site- we could put it on the IPFS, where it would live forever and not need hosted by any one person)

Code: [Select]
[
  {
    "Id": "Controller_Control.Electric_Control",
    "Name": "Electric Control",
    "Powers": [
      {
        "MoreDetail": {
          "Level": "1",
          "Type": "Click",
          "PvE damage scale": "1.000000",
          "Accuracy": "1.2",
          "Modes required": "",
          "Modes disallowed": "Disable_All",
          "Range": "80 feet",
          "Activate period": "",
          "Interrupt time": "",
          "Cast time": "1.67 seconds",
          "Recharge time": "4 seconds",
          "Endurance cost": "7.8",
          "Attack types": "Ranged, Energy",
          "Effect area": "Character",
          "Radius": "",
          "Arc": "",
          "Max targets hit": "",
          "Entities affected": "Foe",
          "Entities autohit": "",
          "Target": "Foe",
          "Target visibility": "Line of Sight",
          "Nofity Mobs": "Always"
        },
        "Id": "Controller_Control.Electric_Control.Electric_Fence",
        "Name": "Electric Fence",
        "NotAvailable": false,
        "Type": "Ranged, Moderate DoT(Energy), Foe Immobilize, -End, -Fly, -Knockback",
        "Description": "Surrounds and Immobilizes a single target in an Electric Fence. Deals some damage over time and slowly drains some Endurance. Useful for keeping villains at bay and bringing down fliers. Damage: Minor(DoT), Recharge: Fast"
      },
      {
        "MoreDetail": {
          "Level": "1",
          "Type": "Click",
          "PvE damage scale": "1.000000",
          "Accuracy": "1.2",
          "Modes required": "",
          "Modes disallowed": "Disable_All",
          "Range": "80 feet",
          "Activate period": "",
          "Interrupt time": "",
          "Cast time": "2.17 seconds",
          "Recharge time": "8 seconds",
          "Endurance cost": "8.528",
          "Attack types": "Ranged, Energy",
          "Effect area": "Character",
          "Radius": "",
          "Arc": "",
          "Max targets hit": "",
          "Entities affected": "Foe",
          "Entities autohit": "",
          "Target": "Foe",
          "Target visibility": "Line of Sight",
          "Nofity Mobs": "Always"
        },
        "Id": "Controller_Control.Electric_Control.Tesla_Cage",
        "Name": "Tesla Cage",
        "NotAvailable": false,
        "Type": "Ranged, Moderate DMG(Energy), Foe Hold, -End",
        "Description": "Tesla Cage confines the target in an electrical prison. The target is overwhelmed by the electrical charge and is left helpless and can be attacked. The target is drained of some Endurance and some of that Endurance may be transferred back to you. Damage: Minor, Recharge: Moderate"
      },


Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #20 on: January 03, 2019, 04:23:12 PM »
If anyone is interested in the data dump
Your wish is my command:

I've also provided this information to the guys over @SEGS
They needed detailed information with regards to the power implementations - as the client files can only get them so far.

https://ipfs.infura.io/ipfs/QmcsEaZBh2d6MsYg9AuNigWHeTM2o43o1GPRAbRez4T3Ki
https://gateway.ipfs.io/ipfs/QmcsEaZBh2d6MsYg9AuNigWHeTM2o43o1GPRAbRez4T3Ki
https://ipfs.io/ipfs/QmcsEaZBh2d6MsYg9AuNigWHeTM2o43o1GPRAbRez4T3Ki

Note - the JSON data for the powers is stored on something called IPFS.
Interplanetary File System is a type of hosting in the 'ether'.
The json file exists in many places - it will remain online and available so long as it is looked at regularly.
The data is static, cannot be manipulated and has no risk of tampering.

I would suggest to a moderator that they consider pinning a topic with the links to the data dump - if people keep looking at the data, then the data will remain available for all of time.

(Data dump is from version 2.4 beta)
Inside the json you will find certain things like
"PVEPowerScaleImage": "QmSMQgC7YX26UNsrHtkj1uihbqtxk2oTKU6YG2C75VEgsU"

For completeness - I took the images that show the level 50 power scale and added them to the IPFS too.
If you really want to look at the scale images, you just need to suffix the hash shown to the end of an IPFS gateway url.
Eg:
https://ipfs.infura.io/ipfs/QmSMQgC7YX26UNsrHtkj1uihbqtxk2oTKU6YG2C75VEgsU

Gives you





This data covers:
Primary, Secondary, Ancillary/Epic powers:

I am still working on Pool Powers and maybe Temporary Powers - if I can get access to Incarnate powers, I will do that too.

spectre1989

  • Minion
  • **
  • Posts: 38
Re: Tomax's site temporarily down
« Reply #21 on: January 03, 2019, 09:22:25 PM »
You sexy mf! Did you manage to find the stuff that wasn't on wayback machine?

Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #22 on: January 03, 2019, 09:46:05 PM »
I wont know unless someone gives me an example.
Some powers were missing their individual power pages, however I was able to get the power data for them from the shared powerset pages.

This only includes Primary, Secondary and Ancillary powers.
That being said - I have been looking into Mid's Hero Designer and have found a way to write all his power data to json files.
It includes everything from Inspirations to invention enhancement proc powers and even incarnate powers.

9000 powers which creates a JSON file that is 126 mb in size

Sekoia

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 1,828
Re: Tomax's site temporarily down
« Reply #23 on: January 03, 2019, 10:08:49 PM »
I'll try to get you an export from our database later tonight. I don't see any reason to make you scrape it from Wayback when I can just dump it for you.

Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #24 on: January 03, 2019, 10:41:26 PM »
That would be very handy -
The guys over at SEGS would also benefit from it too - as they need to find some way to implement the logic for the powers behind the scenes - client files only get you so far.


Codewalker

  • Hero of the City
  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 2,740
  • Moar Dots!
Re: Tomax's site temporarily down
« Reply #25 on: January 04, 2019, 02:06:24 AM »
It looks like you're doing a lot of work that you probably don't need to. I posted a dump of the powers data 6 years ago.

There is one 95% complete one that I know of, however it's not publicly available due to being fairly dependant on my specific development environment to build, and tailored in a way most non-programmers would find unwieldy to use.

Here are text dumps of some of the more useful bin files; they still take a bit of work to find the information you want (a lot of it is structured the way it is due to engine internals), but are easier to read than having to guess at the binary format.

https://docs.google.com/folder/d/0B1YFYcIfwXcoUlBKdVdjRkxHYm8/edit

Grab powers.zip from that google drive.

That would be very handy -
The guys over at SEGS would also benefit from it too - as they need to find some way to implement the logic for the powers behind the scenes - client files only get you so far.

Client files get you all you need if the client is Issue 11.5 or later. The early client that the SEGS folks are using lacks the effect data, but the devs added it in later for the real numbers display to work, and it's the full thing that the server would use to process it.

Sekoia might can get you the COD database, but I'd urge you not to use it. COD and latter-day Mids both got their data from dumps of powers.bin and related files, so the data in that DB is the same as you'll find in powers.zip above, just with some of it stripped out and in a much worse format to do anything useful with. Trust me, I built the 2nd-gen utility to extract powers data and generate csvs for COD, and it was a huge PITA due to the bizarre table structure the site wanted.

Better to use the source game data that it was built from and save yourself the headache.

Codewalker

  • Hero of the City
  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 2,740
  • Moar Dots!
Re: Tomax's site temporarily down
« Reply #26 on: January 04, 2019, 02:44:38 AM »
Since that was dumped a while back and there may have been some minor improvements to the tools, here's a fresh dump.

https://www.dropbox.com/s/3y95iiq7x3ykxqa/cohdata.7z?dl=0

That one includes a lot more files, some of which may be more useful than others to what you're trying to do. You'll need classes.txt (which was missing from my original upload) if you want to calculate actual numbers from damage scale.

Baaleos

  • Boss
  • ****
  • Posts: 117
Re: Tomax's site temporarily down
« Reply #27 on: January 04, 2019, 03:09:43 AM »
Ah - I didnt know there was a data dump previously - as all the posts I found online were of people asking for a dump but no replies.

Thanks for the dumps - I assume it is ok to share this info with the guys at SEGS?
I also managed to extract the power data from Mids Hero Designer and json-ify it.
Not sure if anyone is interested in that etc
The only pro it might have is being in a more object oriented structure

Thanks again for the data

Codewalker

  • Hero of the City
  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 2,740
  • Moar Dots!
Re: Tomax's site temporarily down
« Reply #28 on: January 04, 2019, 03:27:28 AM »
Yeah, it came from the game files and was previously used for COD and other things, so I consider it public info.

Sekoia

  • Titan Network Admin
  • Elite Boss
  • *****
  • Posts: 1,828
Re: Tomax's site temporarily down
« Reply #29 on: January 04, 2019, 03:34:46 AM »
It's probably not necessary given CW's data, but just in case it helps here's the database dump from Tomax:

https://drive.google.com/uc?id=1qczGH8VcOa7V0BeZcmPiD5CYUsK6ErVV&export=download

Share as you like.