[Beta] Squirrel: industrial strength minimap downloader

Hexagon · 2015-07-21 20:02:33

Squirrel is an application that downloads minimaps to .png files. Converting the data to a .png file takes about 2.5 seconds milliseconds (a recent performance breakthrough.)

I'm thinking about reviving Panda, and Squirrel will be a main component of it (thumb-nailing engine.) There's really no servers that it can be run from, which is an issue. We'd need to look at options for image-only hosting or something.

Any thoughts or feedback are appreciated.

Here's the GitHub link: https://github.com/Decagon/Squirrel

SirJosh3917, Era

Gooberg · 2015-07-22 01:49:39

Already created. EEPainter, pretty good though.

Hexagon · 2015-07-22 02:25:21

Gooberg wrote:

Already created. EEPainter, pretty good though.

I haven't tried EEPainter (v1.7.8 crashed when loading minimap), but I have tried a few and I couldn't find any options to:
- run it via a command line (console; little or no GUI)
- use png compression
- to get the latest init data (not the BigDB data that might be out of date)
- be able to save to a file that is able to be correctly read later even if the blocks aren't updated
- load a minimap under ~5 seconds (long time to load something)
- supporting all types of authentication, including kong, mousebreaker and fb
- be able to have the application automatically update, or being able to click a button to update the application
- dynamically choose BigDB or to use init data, depending if the world is in the lobby or not

If your application does support most or all of these features, I'd be happy to work with that developer to gain some understanding into how these things work.

capasha · 2015-07-22 02:48:30

if (layerNum == 0)
                    {
                        // background block

Shouldn't layerNum be 1? That's what I remember.

Gooberg · 2015-07-22 03:12:58

It may export as a .jpeg, though .jpeg's are easily transferrable to .png's

Xfrogman43 · 2015-07-22 05:12:12

Gooberg wrote:

It may export as a .jpeg, though .jpeg's are easily transferrable to .png's

It would be better if there was already a .png export, so you didn't have to.

Hexagon

Gooberg · 2015-07-22 05:13:23

Xfrogman43 wrote:

Gooberg wrote:
It may export as a .jpeg, though .jpeg's are easily transferrable to .png's
It would be better if there was already a .png conversion, so you didn't have to.

I'm still not sure, it may export as a .png

Hexagon · 2015-07-22 13:29:48

capasha wrote:

if (layerNum == 0)
                    {
                        // background block
Shouldn't layerNum be 1? That's what I remember.

I switched it to layerNum == 1, and the minimaps generated look better now. From that modification that you suggested, I was able to fix some other bugs relating to parsing init data, which fixed some issues drawing background blocks after foreground blocks (it should be the opposite.) Thanks!

Gooberg wrote:

It may export as a .jpeg, though .jpeg's are easily transferrable to .png's

It is possible to convert .jpeg's to .png's, however in this scenario pngcrushed'd png's are about ~50% smaller in file size, and are losslessly compressed (100% quality). Jpeg's are larger in file size and have a lower quality.

However, when it comes to compressing larger photos, jpeg is superior over png in both file size and perceived quality.

Different55

Hexagon · 2016-03-02 02:30:00

Unfortunately, it has appeared that EE has updated their world format and Squirrel no longer works correctly. I'm getting a NullReferenceException on this line:

https://github.com/Decagon/Squirrel/blo … ram.cs#L94

Things that I have tried:
- dumping the data at the section (I get x1 and y1 values, and they don't appear to be bytearrays, but integers instead)
- using x1 and y1 values instead of x and y (however, I get an array out of bounds exception in the worlddata array. I have tried to increase the array size to 1000 by 1000 but it still fails with an out of bounds exception, indicating that the width and height parameters are incorrect as the maximum world size is less than 1000.)
- converting the byte arrays to int
- try to detect when xs is null, and stepping over the foreach loop (this is where the error occurs)
- changing x and y to byte[0] when they are null

Does anyone how this could be resolved?

XxAtillaxX · 2016-03-02 03:21:24

Hexagon wrote:

Unfortunately, it has appeared that EE has updated their world format and Squirrel no longer works correctly. I'm getting a NullReferenceException on this line:
https://github.com/Decagon/Squirrel/blo … ram.cs#L94
Things that I have tried:
- dumping the data at the section (I get x1 and y1 values, and they don't appear to be bytearrays, but integers instead)
- using x1 and y1 values instead of x and y (however, I get an array out of bounds exception in the worlddata array. I have tried to increase the array size to 1000 by 1000 but it still fails with an out of bounds exception, indicating that the width and height parameters are incorrect as the maximum world size is less than 1000.)
- converting the byte arrays to int
- try to detect when xs is null, and stepping over the foreach loop (this is where the error occurs)
- changing x and y to byte[0] when they are null
Does anyone how this could be resolved?

I sent a pull request with a potential fix, I cannot test due to Fody having a strange error with compiling, though it should work. Let me know if it does.

Hexagon

capasha · 2016-03-02 14:21:34

Hexagon wrote:

Unfortunately, it has appeared that EE has updated their world format and Squirrel no longer works correctly. I'm getting a NullReferenceException on this line:
https://github.com/Decagon/Squirrel/blo … ram.cs#L94
Things that I have tried:
- dumping the data at the section (I get x1 and y1 values, and they don't appear to be bytearrays, but integers instead)
- using x1 and y1 values instead of x and y (however, I get an array out of bounds exception in the worlddata array. I have tried to increase the array size to 1000 by 1000 but it still fails with an out of bounds exception, indicating that the width and height parameters are incorrect as the maximum world size is less than 1000.)
- converting the byte arrays to int
- try to detect when xs is null, and stepping over the foreach loop (this is where the error occurs)
- changing x and y to byte[0] when they are null
Does anyone how this could be resolved?

It was a long time ago they change the database reading.
Here is an example, http://pastebin.com/Yzy06edk

Hexagon · 2016-03-02 16:08:37

XxAtillaxX wrote:

I sent a pull request with a potential fix, I cannot test due to Fody having a strange error with compiling, though it should work. Let me know if it does.

Thanks, it works now!

---

I'm getting another NullReferenceException while trying to optimize the Color class to a byte array, but I'll see if I can figure this one out...

Official Everybody Edits Forums

#1 2015-07-21 20:02:33, last edited by Hexagon (2016-03-04 17:47:18)

[Beta] Squirrel: industrial strength minimap downloader

#2 2015-07-22 01:49:39

Re: [Beta] Squirrel: industrial strength minimap downloader

#3 2015-07-22 02:25:21, last edited by Hexagon (2015-07-22 02:28:01)

Re: [Beta] Squirrel: industrial strength minimap downloader

#4 2015-07-22 02:48:30

Re: [Beta] Squirrel: industrial strength minimap downloader

#5 2015-07-22 03:12:58

Re: [Beta] Squirrel: industrial strength minimap downloader

#6 2015-07-22 05:12:12, last edited by Xfrogman43 (2015-07-22 05:12:56)

Re: [Beta] Squirrel: industrial strength minimap downloader

#7 2015-07-22 05:13:23

Re: [Beta] Squirrel: industrial strength minimap downloader

#8 2015-07-22 13:29:48

Re: [Beta] Squirrel: industrial strength minimap downloader

#9 2016-03-02 02:30:00

Re: [Beta] Squirrel: industrial strength minimap downloader

#10 2016-03-02 03:21:24

Re: [Beta] Squirrel: industrial strength minimap downloader

#11 2016-03-02 14:21:34

Re: [Beta] Squirrel: industrial strength minimap downloader

#12 2016-03-02 16:08:37, last edited by Hexagon (2016-03-03 21:08:04)

Re: [Beta] Squirrel: industrial strength minimap downloader

Board footer