Jump to content

Project Spelunker

_NOPE_

By _NOPE_
in General Discussion

 Share

Recommended Posts

Ura Hero

Ura Hero

Posted
Posted (edited)

Had a few instances just stop processing.  Looks like they were probably ready to zip and send, but they are just hung.  Going to enable verbose to see if it shows where the stoppage is occurring.

 

Also:

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18614-20120905-002240.warc' ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetResponse()
   at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776
   at COH_WARC_Processor.FTPclient.GetFileSize(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 534
   at COH_WARC_Processor.FTPclient.FtpFileExists(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 508
   at COH_WARC_Processor.FTPclient.FtpRename(String sourceFilename, String newName) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 568
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 148
   --- End of inner exception stack trace ---

 

Edited by Ura Hero
  • Thanks 1
Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted
1 minute ago, Ura Hero said:

Had a few instances just stop processing.  Looks like they were probably ready to zip and send, but they are just hung.  Going to enable verbose to see if it shows where the stoppage is occurring.

 

Also:

  


There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18614-20120905-002240.warc' ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetResponse()
   at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776
   at COH_WARC_Processor.FTPclient.GetFileSize(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 534
   at COH_WARC_Processor.FTPclient.FtpFileExists(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 508
   at COH_WARC_Processor.FTPclient.FtpRename(String sourceFilename, String newName) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 568
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 148
   --- End of inner exception stack trace ---

 

 

Yup, that one processed successfully. Line 148 is where it's trying to move the remote file from the processing folder to the processed folder. I can verify the final output ZIP file on my end, so I've moved that file manually. Go ahead and drop any other file names here that failed at the same spot!

I'm out.
Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

Haven't read these, just posting as I close shop for the overnight run.

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25596-20120905-075300.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-28473-20120906-065235.warc' ---> System.Exception: Failed to upload file. ---> System.IO.IOException: Unable to write data to the transport connection: An established connection was aborted by the software in your host machine. ---> System.Net.Sockets.SocketException: An established connection was aborted by the software in your host machine
   at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size)
   --- End of inner exception stack trace ---
   at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size)
   at System.Net.FtpDataStream.Write(Byte[] buffer, Int32 offset, Int32 size)
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 208
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

 

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted

Those appear to be failing after processing is complete, but when your system was trying to upload the Zip file. Sounds like those ones need to be redone. I've moved those two from Processing back to Input. Unfortunately, connection failures WILL happen. That's a normal part of the whole process, unfortunately. I would recode it to retry automatically, but I don't really have time. It's more efficient for me to just handle these exceptions manually.

I'm out.
Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

*Taps bell* Next!

Side note, Probably shouldn't be running so many at once

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-29094-20120907-085453.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-22842-20120904-190822.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-27715-20120906-032052.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

 

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted
2 minutes ago, WanderingAries said:

*Taps bell* Next!

Side note, Probably shouldn't be running so many at once 


   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136

 

Yeah, all the ones that end with a reference to line 136, that's the line where the Zip file was created, but it failed to upload. Just drop off the filenames of those and I can push them back to the input folder, because they'll have to be restarted all over again.

I'm out.
Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

I'll have to check the remaining ones on the PC, but I just forced about half a dozen down on the Macs that were frozen at "extracting to /0"

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted (edited)

@The Philotic Knight

 

I think we broke the server. I just tried to launch the app half a dozen times in sequence only to connection fail each time.

 

Quote

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetResponse()
   at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776
   at COH_WARC_Processor.FTPclient.ListDirectoryDetail(String directory) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 81
   at COH_WARC_Processor.MainForm.GetFileLists() in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 182

 

Edited by WanderingAries

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
Ura Hero

Ura Hero

Posted
Posted

Ok, had one just hang up again.  No indication of where it is happening except that the output directory has about half of the files that it should have.  I guess it could still be processing, but taking nearly 20 hours on my system would be a really, really long stretch.  Last file was written at 11:35, same as still working timestamp below.  Task Mugger shows that the CPU is still being actively utilized by the process and memory utilization is changing.  I'll let it stay active in case it is just a really difficult file, but I wanted to let you know since it doesn't feel right.

 

BTW, I had already dropped the number of concurrent sessions to avoid the FTP issues that Wandering Aries was having which seems to have worked for that particular issue.

 

image.thumb.png.e6e5223cfb366f00c1841b6780a59239.png

Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted
3 hours ago, Ura Hero said:

Ok, had one just hang up again.  No indication of where it is happening except that the output directory has about half of the files that it should have.  I guess it could still be processing, but taking nearly 20 hours on my system would be a really, really long stretch.  Last file was written at 11:35, same as still working timestamp below.  Task Mugger shows that the CPU is still being actively utilized by the process and memory utilization is changing.  I'll let it stay active in case it is just a really difficult file, but I wanted to let you know since it doesn't feel right.

 

BTW, I had already dropped the number of concurrent sessions to avoid the FTP issues that Wandering Aries was having which seems to have worked for that particular issue.

 

image.thumb.png.e6e5223cfb366f00c1841b6780a59239.png

Yeah, kill it, it's long gone.

 

In other news, my internet is back up, and I'm processing again, so y'all should be able to get back in the game as well!

I'm out.
Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted

Current project status:

image.png.6c6e840174d0372b191fcbcd8c1f442c.png

 

Chugging along, nice and easy! Thanks everyone!

 

@Ura Hero forget what I said about killing the task. I had the same issue with the programs seeming to lock up, and had a couple "lock up" yesterday. But this time I just left them. The last time I checked yesterday, the processing folders for my two instances had been last modified around 07/29/2021 around 7:00 PM and 5:30PM, give or take. I go to check this morning, and this is what I see:

image.png.62eb995a93f01c0c5e2b77da65fface4.png

 

So, it looks like with multiple instances, sometimes they may STILL appear to "lock up" while they are processing. I'm suspecting a large file found inside of those WARC files is the holdup, since the screen doesn't refresh except on every new "internal" file created/found by the program within the WARC file.

 

So, I'd suggest just clicking the "Stop After This Iteration" button, even if you don't SEE it be clicked, the click at that spot inside the UI should still work even if there's no visual indicator until the next screen update. I'm going to test that now with my two instances and try to "kill them" the proper way with that button, and then give them the day and see how long it takes for it to take effect, or if they truly are locked up.

  • Thumbs Up 1
I'm out.
Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted

And I've just confirmed that clicking on the button in the "frozen" program does indeed stop after that iteration is done once the program eventually "unfreezes". I tested it with two separate instances at the same time. One stopped when it was supposed to go to the next iteration (working as expected), and the other  stopped when the screen "refreshed" the next time with an error that I'm going to have to figure out in a specific file:

 

image.thumb.png.da23b33d5eb2d129b9f3a846166f64aa.png

 

Now I have to figure out what the HELL to do with a file that's called "http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900&lti=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+"Tanklet"+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial"

 

Hmm.....

I'm out.
Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

I'll cycle the version later, but I'll match you one Large File error if you wanna note it. 

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-24296-20120904-212344.warc' ---> System.Exception: Failed to handle large WARC file ---> System.Exception: Failed to get filename from string 'http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900&lti=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+%22Tanklet%22+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial'. ---> System.IO.PathTooLongException: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters.
   at System.IO.Path.NewNormalizePathLimitedChecks(String path, Int32 maxPathLength, Boolean expandShortPaths)
   at System.IO.Path.NormalizePath(String path, Boolean fullCheck, Int32 maxPathLength, Boolean expandShortPaths)
   at System.IO.Path.InternalGetDirectoryName(String path)
   at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 588
   --- End of inner exception stack trace ---
   at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 655
   at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 241
   --- End of inner exception stack trace ---
   at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 261
   at WHBennett.WarcExtractionRecord..ctor(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 33
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 116
   --- End of inner exception stack trace ---

 

  • Haha 1

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted
6 hours ago, The Philotic Knight said:

Not really, that just means that WARC needs to be re-processed with the new  version. I'll probably let it sit until most people are on 2.1, then I'll throw it back into the input folder.

 

I'm still waiting on most of the instances to complete. The "frozen is still really processing" concept must take hours More than they've been sitting so far. It's been 6 hours since I multi-clicked them all to stop, but so far only a couple did.

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

Last error before switching to latest version:

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-29639-20120906-125709.warc' ---> System.Exception: Failed to handle large WARC file ---> System.Exception: Failed to get filename from string 'http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900&lti=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+%22Tanklet%22+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial'. ---> System.IO.PathTooLongException: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters.
   at System.IO.Path.NewNormalizePathLimitedChecks(String path, Int32 maxPathLength, Boolean expandShortPaths)
   at System.IO.Path.NormalizePath(String path, Boolean fullCheck, Int32 maxPathLength, Boolean expandShortPaths)
   at System.IO.Path.InternalGetDirectoryName(String path)
   at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 588
   --- End of inner exception stack trace ---
   at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 655
   at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 241
   --- End of inner exception stack trace ---
   at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 261
   at WHBennett.WarcExtractionRecord..ctor(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 33
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 116
   --- End of inner exception stack trace ---

 

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

I've cued up the iMini for 8 instances and will just leave it running I guess as this doesn't seem to impact my W@H bandwidth. I'll cue up the i7 rig as well later, but the MBP may just need to stay off the project. I'm thinking it needs some new thermal pads or something as it'll hit 100C quite easily when running Windows in general where as the iMini hovers at 60C under this load.

  • Thanks 1

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted

Current project status:

 

image.png.bd651dbce9762c3e6ff45fd634fe39ee.png

 

And, the files are looking GREAT! No errors so far that I can see....

 

image.thumb.png.05528f253a0486b7006efc0d3bd3b8b9.png

 

 

image.thumb.png.a50ef95d6cbef3a251165d3c006a31df.png

 

 

Missing pieces of CoH history are coming back, slowly!

 

image.thumb.png.5fb07ca0c321ec9686c736257ed2a0ae.png

 

image.thumb.png.267d9dc5c95302e51d6f7ad068ef69d9.png

 

 

image.thumb.png.3fda03c4a1675f2eafb6b4132e79cb32.png

 

Who remembers "theOcho"? My favorite dev with a name referencing the movie Dodgeball?

 

image.thumb.png.e8a7eeebbb0f3ce7f9fa029771ce8642.png

 

  • Like 1
I'm out.
Link to comment
Share on other sites
WanderingAries

WanderingAries

Posted
Posted

So these times to give a hint that it's still running seem to have large gaps and that may be tricking me into thinking they're frozen. I checked on the batch after work and things with what Look to be AM times are just Now starting to complete/upload.

 

Here are a couple file errors though from the i7. I wonder why they error out at the end?

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18750-20120904-030107.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18496-20120904-014959.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  

There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25012-20120904-233419.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

 

OG Server: Pinnacle  <||>  Current Primary Server: Torchbearer  ||  Also found on the others if desired  <||> Generally Inactive

Installing CoX:  Windows  ||  MacOS  ||  MacOS for M1  <||>  Migrating Data from an Older Installation

Clubs: Mid's Hero Designer  ||  PC Builders  ||  HC Wiki  ||  Jerk Hackers

Old Forums  <||>  Titan Network  <||>  Heroica! (by @Shenanigunner)

 

Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted
8 hours ago, WanderingAries said:

So these times to give a hint that it's still running seem to have large gaps and that may be tricking me into thinking they're frozen. I checked on the batch after work and things with what Look to be AM times are just Now starting to complete/upload.

 

Here are a couple file errors though from the i7. I wonder why they error out at the end?

  


There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18750-20120904-030107.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  


There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18496-20120904-014959.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

  


There was an error in the application. Please copy and paste the following text in a message to the program author:
System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25012-20120904-233419.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server
   at System.Net.FtpWebRequest.GetRequestStream()
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204
   --- End of inner exception stack trace ---
   at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227
   at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108
   at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136
   --- End of inner exception stack trace ---

 

 

Unfortunately, random communication errors will occur. Not much I can do about that. Shit happens. 😢 Just try again.

I'm out.
Link to comment
Share on other sites
_NOPE_

_NOPE_

Posted
  • Author
Posted (edited)
6 hours ago, Paulus said:

Just got this bad boy fired up on my system, looking forward to seeing the info from the old forums again. I'll upload errors if I get any.

Glad to have you aboard. The whole "final product" will be available for viewing at http://cohforums.cityofplayers.com/ when the project is complete. Right now, I have the results from the last "attempt", which is in fact the full set of files. BUT many of them are "corrupted" because I wasn't aware of HTTP "Chunked transfer encoding". I discovered that when looking through the final data from all of the outputs. It contained many "odd" bits in the HTML files that looked like (and were) checksum digits, and the same thing happened with MANY images, making most of the images unreadable by any image viewing program due to corruption.

 

But, I've got chunked transfer encoding handled, and so far so good, everything's been looking great! I've been checking random files once a day, and they've all looked really good.

 

If you want to view the "results" of your work (at least temporarily), and see what your processor is doing, you can head over to the hidden temp folder "C:\Users\[INSERT USERNAME HERE]\AppData\Local\Temp\CoH_Forums_Output" and see how things are shaking as it's processing. With the stipulation that you just lookie and don't touchie, because if you mess with the files, it'll mess with the process and cause failures.

 

Anyways, welcome aboard, glad to have another Spelunker aboard! 😁

Edited by The Philotic Knight
  • Like 1
I'm out.
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...