Emergency Maintenance and Aftermath (2/12/24)

[Widower]

Hi all,

 

Around 1:00 PM EST (6:00 PM UTC) on 2/12/24 we became aware of some issues with one of the database servers and had to take it down for emergency maintenance. We have resolved the immediate problem, and do not anticipate any further issues. However you may experience short-term rollbacks (roughly 4-5 hours) on characters on Torchbearer or Indomitable, as well as missing/duplicated items in your email or on the AH from the preceding 24 hours. If you do notice anything missing, please submit a ticket through the support portal and mark it as "Lost Item and Influence Claim." Moreover, characters that tried to transfer to those shards this morning may also be stuck in transit; submit a ticket and a GM will get your character back as soon as possible.

 

Thank you for your patience! We will have further details available as soon as we can.

[Gunrar]

Rollbaaaaacks *shakes old man fist*

 

From here, this looks like an accountant's nightmare.  Thanks to the unpaid staff for working to clean this up ❤️

[Shenanigunner]

All of my alts lost complete LotG sets. Really. 😄

[ZorkNemesis]

I can't check now, but what do these rollbacks enatil?  I played a couple hours on Indom before this went down, does this mean I have to take my Defender through the Talons and Monsters in Cimerora again?

Edited February 13 by ZorkNemesis

[wjrasmussen]

3 hours ago, Shenanigunner said:

All of my alts lost complete LotG sets. Really. 😄

Along with all my billions of influence.

[kelika2]

5 hours ago, Widower said:

However you may experience short-term rollbacks (roughly 4-5 hours) on characters on Torchbearer or Indomitable

I wish I had the artistic talent to draw a representation of my character being pulled back into praetoria kicking and screaming

[UltraAlt]

5 hours ago, Widower said:

Thank you for your patience! We will have further details available as soon as we can.

 

I guess the real question is should be avoid using the market and email on Torchbearer and Indomitable until we hear back about this issue? 

 

 

Edited February 13 by UltraAlt

[Six-Six]

I have an opposite experience. After the forced shutdown, I found 5 duplicate IOs in my AH Stored window. these were the 5 IOs that I removed from the AH Stored space right before the emergency maintenance. I suppose I'll just leave them there until the Devs resolve them.

[Scarlet Shocker]

3 hours ago, wjrasmussen said:

Along with all my billions of influence.

and my FIFTEEN complete purple sets!

[UltraAlt]

47 minutes ago, Scarlet Shocker said:

4 hours ago, wjrasmussen said:

Along with all my billions of influence.

and my FIFTEEN complete purple sets!

 

I assume you both mean per character

[Scarlet Shocker]

57 minutes ago, UltraAlt said:

 

I assume you both mean per character

 

Per character across all my 24 accounts

[Etched]

So I logged on my fire/ninja this mornin to move some enhancements over to my bank and a huge surprise awaited me. Yesterday before the maintenance I ran an Aeon sf with 2 of my friends. This mornin the toon is missing multiple powers from my primary, secondary, pool powers and all of my epics! Not a happy camper right now. I took these on my phone because i don't know how to do a screen shot while in the enhancement screen.

 

 

@Etched

 

[Lunar Ronin]

13 minutes ago, Etched said:

So I logged on my fire/ninja this mornin to move some enhancements over to my bank and a huge surprise awaited me. Yesterday before the maintenance I ran an Aeon sf with 2 of my friends. This mornin the toon is missing multiple powers from my primary, secondary, pool powers and all of my epics! Not a happy camper right now. I took these on my phone because i don't know how to do a screen shot while in the enhancement screen.

 

 

@Etched

 

 

 

Sadly, you're not the only one as others were hit by that as well.  Submit a ticket here.

[Etched]

18 minutes ago, Lunar Ronin said:

 

 

Sadly, you're not the only one as others were hit by that as well.  Submit a ticket here.

I already posted a ticket while I was logged in. Really hope those like myself that was affected by this get back to norm quickly. 

 

@Etched

[FusionCore3]

Are all servers actually down atm?  (8:47am US Central)?  Ping to 51.161.76.201 is successful but all servers show greyed out / down status on server selection screen.  

 

[FusionCore3]

eh, nvm... status page shows same thing.  sorry for the panic post lol

[Greldek]

I'm missing about 70mil from my mail , not too worried about it, just glad to see i wasn't going crazy cause i was sure i mailed myself inf and now its not there :p

[BlakeTheDrake]

Wait, so, the servers are STILL down because of this? The 'Aftermath' bit kind of implied that it was already over. I wanted to log in to check if any of my characters were missing anything, but...

[Widower]

13 hours ago, ZorkNemesis said:

I can't check now, but what do these rollbacks enatil?  I played a couple hours on Indom before this went down, does this mean I have to take my Defender through the Talons and Monsters in Cimerora again?

Potentially; some characters may have saved to the database, but as you can see, some have not.

 

8 hours ago, UltraAlt said:

 

I guess the real question is should be avoid using the market and email on Torchbearer and Indomitable until we hear back about this issue? 

 

 

No, the problem should be fixed. Also, auctionserver and chatserver are global services and operate across all five shards; they just happen to live on the same SQL host as Torchbearer and Indomitable. 

 

1 minute ago, BlakeTheDrake said:

Wait, so, the servers are STILL down because of this? The 'Aftermath' bit kind of implied that it was already over. I wanted to log in to check if any of my characters were missing anything, but...

Nope, just regular Tuesday maintenance.

[jhyoo1487]

is there anyone who know server open time???

[heyedwin]

 

 

 

Edited February 13 by heyedwin
Added another meme, again.

[Player2]

I submitted a ticket for my character's lost dignity, but apparently no one can help me.

[Jacke]

3 hours ago, Etched said:

So I logged on my fire/ninja this mornin to move some enhancements over to my bank and a huge surprise awaited me. Yesterday before the maintenance I ran an Aeon sf with 2 of my friends. This mornin the toon is missing multiple powers from my primary, secondary, pool powers and all of my epics! Not a happy camper right now.

 

Ouch!  Not a dev, but that sounds like your toon's last save was mangled.  Be sure you put in a Support ticket ASAP reporting that so it can be resolved.

 

 

3 hours ago, Etched said:

I took these on my phone because i don't know how to do a screen shot while in the enhancement screen.

 

It's a bit of a pain, but here's how to do it on Windows (other OSs use similar steps):

1. Have a graphics program like Irfanview 64 running with no image (in Irfanview, press the D key to delete anything present).
2. Alt-Tab to display the City client showing your Enhancement screen.  Scroll to the top on the right pane to show all the powers at top of that long listing.
3. Type Alt+PrtScr to get a screencapture of the active window.
4. Alt-Tab to display the graphics program.
5. Type Ctrl+V to paste the screencapture into the graphics program.
6. In the graphics program, save the current screencapture to a new filename.
7. Delete the current image to be ready for the next screencapture (in Irfanview, press the D key to delete anything present).
8. If still have powers in the right pane to screencapture
   • Alt-Tab back to the City client.
   • Scroll down the right pane to display the next set of powers
   • Then go back and do again steps #3 to #8
     • Remembering to save the next screencapture to a new file name.
     • Likely with "1", "2", etc,. in the filename for each successive screenshot.
9. If all the screencaptures are complete, you're done.

[Shenanigunner]

11 hours ago, kelika2 said:

I wish I had the artistic talent to draw a representation of my character being pulled back into praetoria kicking and screaming

 

That would be golden.

[Shenanigunner]

4 hours ago, Etched said:

I took these on my phone because i don't know how to do a screen shot while in the enhancement screen.

 

Under Windows, Snipping Tool will work in CoX if you have it activated and enabled (Ctrl-Win-S). That can be more efficient than full screenshots at gaming resolution...