Ura Hero Posted July 28, 2021 Posted July 28, 2021 (edited) Had a few instances just stop processing. Looks like they were probably ready to zip and send, but they are just hung. Going to enable verbose to see if it shows where the stoppage is occurring. Also: There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18614-20120905-002240.warc' ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetResponse() at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776 at COH_WARC_Processor.FTPclient.GetFileSize(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 534 at COH_WARC_Processor.FTPclient.FtpFileExists(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 508 at COH_WARC_Processor.FTPclient.FtpRename(String sourceFilename, String newName) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 568 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 148 --- End of inner exception stack trace --- Edited July 28, 2021 by Ura Hero 1
_NOPE_ Posted July 28, 2021 Author Posted July 28, 2021 1 minute ago, Ura Hero said: Had a few instances just stop processing. Looks like they were probably ready to zip and send, but they are just hung. Going to enable verbose to see if it shows where the stoppage is occurring. Also: There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18614-20120905-002240.warc' ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetResponse() at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776 at COH_WARC_Processor.FTPclient.GetFileSize(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 534 at COH_WARC_Processor.FTPclient.FtpFileExists(String filename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 508 at COH_WARC_Processor.FTPclient.FtpRename(String sourceFilename, String newName) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 568 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 148 --- End of inner exception stack trace --- Yup, that one processed successfully. Line 148 is where it's trying to move the remote file from the processing folder to the processed folder. I can verify the final output ZIP file on my end, so I've moved that file manually. Go ahead and drop any other file names here that failed at the same spot! I'm out.
WanderingAries Posted July 28, 2021 Posted July 28, 2021 Haven't read these, just posting as I close shop for the overnight run. There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25596-20120905-075300.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-28473-20120906-065235.warc' ---> System.Exception: Failed to upload file. ---> System.IO.IOException: Unable to write data to the transport connection: An established connection was aborted by the software in your host machine. ---> System.Net.Sockets.SocketException: An established connection was aborted by the software in your host machine at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size) --- End of inner exception stack trace --- at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size) at System.Net.FtpDataStream.Write(Byte[] buffer, Int32 offset, Int32 size) at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 208 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
_NOPE_ Posted July 28, 2021 Author Posted July 28, 2021 Those appear to be failing after processing is complete, but when your system was trying to upload the Zip file. Sounds like those ones need to be redone. I've moved those two from Processing back to Input. Unfortunately, connection failures WILL happen. That's a normal part of the whole process, unfortunately. I would recode it to retry automatically, but I don't really have time. It's more efficient for me to just handle these exceptions manually. I'm out.
WanderingAries Posted July 28, 2021 Posted July 28, 2021 *Taps bell* Next! Side note, Probably shouldn't be running so many at once There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-29094-20120907-085453.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-22842-20120904-190822.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-27715-20120906-032052.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
_NOPE_ Posted July 28, 2021 Author Posted July 28, 2021 2 minutes ago, WanderingAries said: *Taps bell* Next! Side note, Probably shouldn't be running so many at once at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 Yeah, all the ones that end with a reference to line 136, that's the line where the Zip file was created, but it failed to upload. Just drop off the filenames of those and I can push them back to the input folder, because they'll have to be restarted all over again. I'm out.
WanderingAries Posted July 28, 2021 Posted July 28, 2021 I'll have to check the remaining ones on the PC, but I just forced about half a dozen down on the Macs that were frozen at "extracting to /0" OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
WanderingAries Posted July 29, 2021 Posted July 29, 2021 (edited) @The Philotic Knight I think we broke the server. I just tried to launch the app half a dozen times in sequence only to connection fail each time. Quote There was an error in the application. Please copy and paste the following text in a message to the program author: System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetResponse() at COH_WARC_Processor.FTPclient.GetStringResponse(FtpWebRequest ftp) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 776 at COH_WARC_Processor.FTPclient.ListDirectoryDetail(String directory) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 81 at COH_WARC_Processor.MainForm.GetFileLists() in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 182 Edited July 29, 2021 by WanderingAries OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
_NOPE_ Posted July 29, 2021 Author Posted July 29, 2021 Y'all didn't do it... this time. A severe storm killed my internet (yes my server is hosted locally): https://www.weau.com/2021/07/28/weather-alert-dangerous-outbreak-severe-weather-expected-this-evening/ I'll let you know when we're back up and running again. I'm out.
Ura Hero Posted July 29, 2021 Posted July 29, 2021 Ok, had one just hang up again. No indication of where it is happening except that the output directory has about half of the files that it should have. I guess it could still be processing, but taking nearly 20 hours on my system would be a really, really long stretch. Last file was written at 11:35, same as still working timestamp below. Task Mugger shows that the CPU is still being actively utilized by the process and memory utilization is changing. I'll let it stay active in case it is just a really difficult file, but I wanted to let you know since it doesn't feel right. BTW, I had already dropped the number of concurrent sessions to avoid the FTP issues that Wandering Aries was having which seems to have worked for that particular issue.
_NOPE_ Posted July 29, 2021 Author Posted July 29, 2021 3 hours ago, Ura Hero said: Ok, had one just hang up again. No indication of where it is happening except that the output directory has about half of the files that it should have. I guess it could still be processing, but taking nearly 20 hours on my system would be a really, really long stretch. Last file was written at 11:35, same as still working timestamp below. Task Mugger shows that the CPU is still being actively utilized by the process and memory utilization is changing. I'll let it stay active in case it is just a really difficult file, but I wanted to let you know since it doesn't feel right. BTW, I had already dropped the number of concurrent sessions to avoid the FTP issues that Wandering Aries was having which seems to have worked for that particular issue. Yeah, kill it, it's long gone. In other news, my internet is back up, and I'm processing again, so y'all should be able to get back in the game as well! I'm out.
_NOPE_ Posted July 30, 2021 Author Posted July 30, 2021 Current project status: Chugging along, nice and easy! Thanks everyone! @Ura Hero forget what I said about killing the task. I had the same issue with the programs seeming to lock up, and had a couple "lock up" yesterday. But this time I just left them. The last time I checked yesterday, the processing folders for my two instances had been last modified around 07/29/2021 around 7:00 PM and 5:30PM, give or take. I go to check this morning, and this is what I see: So, it looks like with multiple instances, sometimes they may STILL appear to "lock up" while they are processing. I'm suspecting a large file found inside of those WARC files is the holdup, since the screen doesn't refresh except on every new "internal" file created/found by the program within the WARC file. So, I'd suggest just clicking the "Stop After This Iteration" button, even if you don't SEE it be clicked, the click at that spot inside the UI should still work even if there's no visual indicator until the next screen update. I'm going to test that now with my two instances and try to "kill them" the proper way with that button, and then give them the day and see how long it takes for it to take effect, or if they truly are locked up. 1 I'm out.
_NOPE_ Posted July 30, 2021 Author Posted July 30, 2021 And I've just confirmed that clicking on the button in the "frozen" program does indeed stop after that iteration is done once the program eventually "unfreezes". I tested it with two separate instances at the same time. One stopped when it was supposed to go to the next iteration (working as expected), and the other stopped when the screen "refreshed" the next time with an error that I'm going to have to figure out in a specific file: Now I have to figure out what the HELL to do with a file that's called "http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900<i=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+"Tanklet"+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial" Hmm..... I'm out.
_NOPE_ Posted July 30, 2021 Author Posted July 30, 2021 All of this pain and agony.... For... this? Spoiler 1 I'm out.
_NOPE_ Posted July 30, 2021 Author Posted July 30, 2021 Version 2.1 has now been released with that bug fix, if you want to avoid running across that bug with RIDICULOUSLY long URL filenames. I'm out.
WanderingAries Posted July 30, 2021 Posted July 30, 2021 I'll cycle the version later, but I'll match you one Large File error if you wanna note it. There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-24296-20120904-212344.warc' ---> System.Exception: Failed to handle large WARC file ---> System.Exception: Failed to get filename from string 'http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900<i=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+%22Tanklet%22+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial'. ---> System.IO.PathTooLongException: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters. at System.IO.Path.NewNormalizePathLimitedChecks(String path, Int32 maxPathLength, Boolean expandShortPaths) at System.IO.Path.NormalizePath(String path, Boolean fullCheck, Int32 maxPathLength, Boolean expandShortPaths) at System.IO.Path.InternalGetDirectoryName(String path) at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 588 --- End of inner exception stack trace --- at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 655 at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 241 --- End of inner exception stack trace --- at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 261 at WHBennett.WarcExtractionRecord..ctor(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 33 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 116 --- End of inner exception stack trace --- 1 OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
_NOPE_ Posted July 30, 2021 Author Posted July 30, 2021 Not really, that just means that WARC needs to be re-processed with the new version. I'll probably let it sit until most people are on 2.1, then I'll throw it back into the input folder. I'm out.
WanderingAries Posted July 31, 2021 Posted July 31, 2021 6 hours ago, The Philotic Knight said: Not really, that just means that WARC needs to be re-processed with the new version. I'll probably let it sit until most people are on 2.1, then I'll throw it back into the input folder. I'm still waiting on most of the instances to complete. The "frozen is still really processing" concept must take hours More than they've been sitting so far. It's been 6 hours since I multi-clicked them all to stop, but so far only a couple did. OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
WanderingAries Posted July 31, 2021 Posted July 31, 2021 Last error before switching to latest version: There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-29639-20120906-125709.warc' ---> System.Exception: Failed to handle large WARC file ---> System.Exception: Failed to get filename from string 'http://titanindustries.guildportal.com/UI/SigGenHandler.ashx?mainText=Tanklet&mtCol1=FF0000&mtCol2=FF9900<i=65&tti=10&otherCol1=FFFFFF&otherCol2=FFFFFF&bgCol1=0000FF&bgCol2=000000&sub1=Player+%26+writer+of+all+things+RPsz&sub2=Use+%22Tanklet%22+to+find+me+on+globals&r1=&r2=&r3=&r4=&pt=10&pl=5&fs1=16&fs2=9&mtGt=0&pGt=1&bgImgUrl=&thumbImgUrl=http%3a%2f%2fwww.guildportal.com%2fCargo%2fSystem%2fLayout2006%2fSigThumbs%2fWorld+of+Warcraft%2f8.gif&mtBorderCol=000000&font=Red+Circle&fontSmall=Arial'. ---> System.IO.PathTooLongException: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters. at System.IO.Path.NewNormalizePathLimitedChecks(String path, Int32 maxPathLength, Boolean expandShortPaths) at System.IO.Path.NormalizePath(String path, Boolean fullCheck, Int32 maxPathLength, Boolean expandShortPaths) at System.IO.Path.InternalGetDirectoryName(String path) at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 588 --- End of inner exception stack trace --- at WHBennett.WarcExtractionRecord.GetSanitizedFileName(String input, String outputDir) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 655 at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 241 --- End of inner exception stack trace --- at WHBennett.WarcExtractionRecord.StreamWARCFile(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 261 at WHBennett.WarcExtractionRecord..ctor(String sourceFileName, String outputDirectory, ToolStripStatusLabel& tssl) in C:\Projects\COH WARC Handler\WHB WARC Handler\WarcRecord.cs:line 33 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 116 --- End of inner exception stack trace --- OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
WanderingAries Posted August 1, 2021 Posted August 1, 2021 I've cued up the iMini for 8 instances and will just leave it running I guess as this doesn't seem to impact my W@H bandwidth. I'll cue up the i7 rig as well later, but the MBP may just need to stay off the project. I'm thinking it needs some new thermal pads or something as it'll hit 100C quite easily when running Windows in general where as the iMini hovers at 60C under this load. 1 OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
_NOPE_ Posted August 1, 2021 Author Posted August 1, 2021 Current project status: And, the files are looking GREAT! No errors so far that I can see.... Missing pieces of CoH history are coming back, slowly! Who remembers "theOcho"? My favorite dev with a name referencing the movie Dodgeball? 1 I'm out.
WanderingAries Posted August 2, 2021 Posted August 2, 2021 So these times to give a hint that it's still running seem to have large gaps and that may be tricking me into thinking they're frozen. I checked on the batch after work and things with what Look to be AM times are just Now starting to complete/upload. Here are a couple file errors though from the i7. I wonder why they error out at the end? There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18750-20120904-030107.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18496-20120904-014959.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25012-20120904-233419.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- OG Server: Pinnacle <||> Current Primary Server: Torchbearer || Also found on the others if desired <||> Generally Inactive Installing CoX: Windows || MacOS || MacOS for M1 <||> Migrating Data from an Older Installation Clubs: Mid's Hero Designer || PC Builders || HC Wiki || Jerk Hackers Old Forums <||> Titan Network <||> Heroica! (by @Shenanigunner)
Paulus Posted August 2, 2021 Posted August 2, 2021 Just got this bad boy fired up on my system, looking forward to seeing the info from the old forums again. I'll upload errors if I get any. 1
_NOPE_ Posted August 2, 2021 Author Posted August 2, 2021 8 hours ago, WanderingAries said: So these times to give a hint that it's still running seem to have large gaps and that may be tricking me into thinking they're frozen. I checked on the batch after work and things with what Look to be AM times are just Now starting to complete/upload. Here are a couple file errors though from the i7. I wonder why they error out at the end? There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18750-20120904-030107.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-18496-20120904-014959.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- There was an error in the application. Please copy and paste the following text in a message to the program author: System.Exception: Error while processing file 'boards.cityofheroes.com-threads-range-25012-20120904-233419.warc' ---> System.Exception: Failed to upload file. ---> System.Net.WebException: Unable to connect to the remote server at System.Net.FtpWebRequest.GetRequestStream() at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 204 --- End of inner exception stack trace --- at COH_WARC_Processor.FTPclient.Upload(FileInfo fi, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 227 at COH_WARC_Processor.FTPclient.Upload(String localFilename, String targetFilename) in C:\Projects\COH WARC Handler\WHB WARC Processor\FTP Client.cs:line 108 at COH_WARC_Processor.MainForm.BtnProcess_Click(Object sender, EventArgs e) in C:\Projects\COH WARC Handler\WHB WARC Processor\MainForm.cs:line 136 --- End of inner exception stack trace --- Unfortunately, random communication errors will occur. Not much I can do about that. Shit happens. 😢 Just try again. I'm out.
_NOPE_ Posted August 2, 2021 Author Posted August 2, 2021 (edited) 6 hours ago, Paulus said: Just got this bad boy fired up on my system, looking forward to seeing the info from the old forums again. I'll upload errors if I get any. Glad to have you aboard. The whole "final product" will be available for viewing at http://cohforums.cityofplayers.com/ when the project is complete. Right now, I have the results from the last "attempt", which is in fact the full set of files. BUT many of them are "corrupted" because I wasn't aware of HTTP "Chunked transfer encoding". I discovered that when looking through the final data from all of the outputs. It contained many "odd" bits in the HTML files that looked like (and were) checksum digits, and the same thing happened with MANY images, making most of the images unreadable by any image viewing program due to corruption. But, I've got chunked transfer encoding handled, and so far so good, everything's been looking great! I've been checking random files once a day, and they've all looked really good. If you want to view the "results" of your work (at least temporarily), and see what your processor is doing, you can head over to the hidden temp folder "C:\Users\[INSERT USERNAME HERE]\AppData\Local\Temp\CoH_Forums_Output" and see how things are shaking as it's processing. With the stipulation that you just lookie and don't touchie, because if you mess with the files, it'll mess with the process and cause failures. Anyways, welcome aboard, glad to have another Spelunker aboard! 😁 Edited August 2, 2021 by The Philotic Knight 1 I'm out.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now