All of them - ArchivEE

capasha · 2021-03-29 14:11:33

EnanoTLL wrote:

im not sure if this is a bug with the program of the database but for some reason piano tiles with a negative ID (pretty much anything below C3) becomes 0. this kinda (completely) ruined many music worlds and i was wondering if there was a fix for this

This is because EELVL save them as integers, and not UINT like EE handle them.

LukeM · 2021-04-26 15:11:55

Oh oops, since EE shut down I’ve been keeping up with the forums through GregBot in the EE discord, and it seems like it hasn’t been picking up replies here for some reason?

Yes I still intend to do a big bugfix update, but I’ve had some university stuff I’ve needed to do and we’re about to start exam season, so it might be a month or two before I get around to it.

In the meantime I’ve got the raw EE worlds database saved so no data was lost, it’s just too big to share for people to download so any bugs in my compression code mean that data isn’t saved correctly in the archive. I’ll add all the bugs people find to a list of things to fix and release a new copy of the archive when I have time.

Until then it sounds like the EE database is still up, so if you do run into one of the worlds that were corrupted, other people have released tools to download them directly.

N1KF · 2021-10-03 23:30:53

You still there, LukeM?

HydraK90 · 2021-10-04 03:06:17

Oh SICK i'll check this out!! after i get a computer that doesn't die when you open two tabs

LukeM · 2021-10-06 12:18:15

N1KF wrote:

You still there, LukeM?

Hi

I've made most of the bugfixes but ran into a few weird ones I didn't manage to get fixed before something else came up over the summer.

I was looking through a bunch of worlds with Kirby to try and work out which ones are missing, so that I could try and work out how to fix them. A good number of them are fixed (and I've sent Kirby a half-finished version of the archive to look through), but there are still some I'm pretty sure can be fixed where I haven't worked out what's wrong yet.

N1KF

N1KF · 2021-10-25 21:34:18

Do any C# programmers want to try compiling and distributing the new ArchivEE reader executables? I'd rather not do this myself because IDEs tend to cost me hours of troubleshooting just to get everything working correctly. This is the perfect chance to give N1KF malware, people!

N1KF · 2021-10-26 02:27:35

Double posting because this is useful. To get around the crashes when extracting large amounts of worlds, use a SQL request to get a large range of worlds, like this:

SELECT * FROM world WHERE rowid BETWEEN 1 AND 20000

Then when it crashes, use the number of files you've extracted or the most recent world to find the rowid to be skipped and start from the world after it.

I've found the following rowids have broken names and should be skipped for now

 22315 PW1vMlHJeFbEI
 61856 PW85QR8-tgbEI
173798 PWMSEu3miFbEI
200649 PWQeP9KAqJbEI
204541 PWREvvUvJabEI
212500 PWSOK88w_FbEI
272526 PWaj__fRDIbEI
282171 PWcA_ztHsbbUI
287895 PWd5ISf4pzbEI
289541 PWdNZoqzmEbEI
304592 PWfedEXuA4bEI
326848 PWj537vuKlbEI
343102 PWlb3PMWmDbEI
373114 PWqI-wXutjbEI
395767 PWtm1vdSiCbEI
407490 PWvgk7_rgibUI

It should be possible to write an SQL line that goes through all worlds except those with the broken names, like so:

SELECT * FROM world WHERE NOT (
rowid= 22315 OR rowid= 61856 OR rowid=173798 OR rowid=200649 OR
rowid=204541 OR rowid=212500 OR rowid=272526 OR rowid=282171 OR
rowid=287895 OR rowid=289541 OR rowid=304592 OR rowid=326848 OR
rowid=343102 OR rowid=373114 OR rowid=395767 OR rowid=407490
)

(Haven't tested it in ArchivEE, but it works in DB Browser.)

N1KF · 2021-10-27 01:01:12

Triple posting because I finally got these 16 inaccessible worlds after spending way longer than I should have fiddling with SQLite databases. Here they are:

https://download857.mediafire.com/4602a … dNames.zip (73 KB)

The more popular worlds include )))))... by eeisfullofnoobs (a 25x25 key race), -->BLIND MAZE LEVEL UP<-- by Terence22205, Musicart 2 by Mathy & Sensei1, *Weird As Hell / Easy* By:ExPl, and Loonely Noob Boss. The remaining eleven? They're all named "only nazis" and some have multiline ASCII swastikas in the title. Fortunately they just look like basic EE worlds.

Yu · 2022-01-21 07:12:05

It wasn't working for me until I tried running it as administrator for anyone with the same issue

rualbr · 2022-02-18 20:29:15

Hello, I wanted to have a look at my older worlds but then I realised that my computer inst compatible with this program, i know its a little late, but if possible, could you release a version of that program compatible with 32bit windows 7 computers? Would be a huge help for a lot of people with the same problema as mine.

N1KF · 2022-03-25 06:36:00

Why is FLD DigBot a campaign world

edit: oh

LukeM · 2022-08-28 20:37:44

ArchivEE 2: Electric Boogaloo

Download here!

Changelog:
- Fixed gravity effects
- Fixed world portal spawn points
- Fixed time trial times (can't remember what this meant but I had it ticked off so I guess it's fixed?)
- Fixed crashes during world exports
- Split the world table in two, one part for metadata and one part for world contents, allowing for de-duplication of worlds with the same contents
- Improved world compression using zstd rather than lzma, allowing for better compression of small files using a common dictionary
- Improved query result loading, allowing the results to be streamed in rather than loading the entire result to memory before beginning processing
- Added roughly 45k worlds to the archive which were previously missed
- Added roughly 720k empty and home worlds
- Probably more that I've forgotten
- All this in an only 15MB larger download!

I'll leave this here for a short while so people can try it out and report any bugs, then once I'm reasonably sure everything is working I'll update the main post, along with uploading a version of the database using the previous format for compatability reasons, and possibly Linux and MacOS versions if I can manage to get these to work.

Plz let me know if you find any bugs, missing worlds, etc and I'll make sure to fix them some time in the next 2 years!

Snowester, N1KF

LukeM · 2022-08-28 20:57:38

Also oops, seems like the forums channel of the discord stopped picking up replies here again for some reason?

N1KF wrote:

Do any C# programmers want to try compiling and distributing the new ArchivEE reader executables? I'd rather not do this myself because IDEs tend to cost me hours of troubleshooting just to get everything working correctly. This is the perfect chance to give N1KF malware, people!

Done! I'll upload the new reader (should be compatible with both the old and new databases) individually if you don't want to wait for the full download when I update the main post.

N1KF wrote:

Triple posting because I finally got these 16 inaccessible worlds after spending way longer than I should have fiddling with SQLite databases. Here they are:
https://download857.mediafire.com/4602a … dNames.zip (73 KB)
The more popular worlds include )))))... by eeisfullofnoobs (a 25x25 key race), -->BLIND MAZE LEVEL UP<-- by Terence22205, Musicart 2 by Mathy & Sensei1, *Weird As Hell / Easy* By:ExPl, and Loonely Noob Boss. The remaining eleven? They're all named "only nazis" and some have multiline ASCII swastikas in the title. Fortunately they just look like basic EE worlds.

I believe these should all be fixed in the new archive, let me know if not.

rualbr wrote:

Hello, I wanted to have a look at my older worlds but then I realised that my computer inst compatible with this program, i know its a little late, but if possible, could you release a version of that program compatible with 32bit windows 7 computers? Would be a huge help for a lot of people with the same problema as mine.

A lot of the dependencies used to make this work only run on 64 bit windows sorry, if I have time I might see if I can get them to compile for an older version, but I'm not sure if it will work and I don't have access to a 32 bit computer to test it on, so it'll be difficult to debug.

N1KF

NoNK · 2022-08-31 05:52:54

yoo 720k empty worlds

N1KF

N1KF · 2022-08-31 06:33:11

NoNK wrote:

yoo 720k empty worlds

That's what I've been waiting for.

NoNK · 2022-09-02 14:43:24

finally i can have a place to build instead of overwriting other people's levels

ExFabian, LukeM, Ruben101, Snowester

LukeM · 2023-01-29 13:41:54

Update!

Seb has complained about some more worlds which were missing, I've fixed some of the issues causing this and will upload a new archive (and actually release it this time) Soon™!

(approx 626k new worlds, almost entirely spam, but with around 3000 which might be nice to have)

Details for nerds: Previously I had to filter out all these spam worlds since it tripled the size of the archive, but since I've added world de-duplication (which is what allowed me to include home and empty worlds) this no longer matters as much, so might as well just include all of them.

Send me or Seb a message on discord I guess if you want an early sneak peek at the new worlds (and look for any issues / more missing worlds / etc so I don't have to!)

MartenM, Grilyon2, N1KF, hummerz5

N1KF · 2023-01-31 08:32:29

Neat! I got the archive early myself, and I'm wondering, are there still plans to include the extended metadata (like potion settings and woot counts)?

hummerz5 · 2023-02-03 03:42:40

I'm excited to see the extended version. In particular, I'm looking for worlds of incorrect sizes. I've been hunting for years, actually. I can say with confidence that we're missing like... five?

Lawr250 · 2023-02-08 18:54:11

Thank so much! With this program, I found and downloaded my old worlds)

NoNK

NoNK · 2023-02-10 08:51:29

Love that for you, edit on brother

Joeyjoey65 · 2023-08-15 06:12:46

hi I just want to say that you posted archive 2.0 in a diff post but you never actually updated main one (google drive), anyways thank for making

N1KF · 2023-10-01 04:25:00

Back in February, LukeM posted an ArchivEE 2.1 test version on Discord. It has thousands more worlds, and apparently fixed something, but I don't know what.

https://1drv.ms/u/s!Ahk6r7GFlmqRkK4XpcT … Q?e=6XQ6MP

N1KF · 2024-04-04 23:49:50

It's been brought to my attention that The Stone Temple, with the ID PWwwAAAA (ID mentioned by Xenonetix) is not included in ArchivEE. It may be because the world has no owner, as seen in the video below.

Do you have saved worlds with no owner?

NoNK · 2024-04-20 02:18:31

very interesting

Official Everybody Edits Forums

#26 2021-03-29 14:11:33

Re: All of them - ArchivEE

#27 2021-04-26 15:11:55

Re: All of them - ArchivEE

#28 2021-10-03 23:30:53

Re: All of them - ArchivEE

#29 2021-10-04 03:06:17

Re: All of them - ArchivEE

#30 2021-10-06 12:18:15

Re: All of them - ArchivEE

#31 2021-10-25 21:34:18

Re: All of them - ArchivEE

#32 2021-10-26 02:27:35, last edited by N1KF (2021-10-26 06:29:58)

Re: All of them - ArchivEE

#33 2021-10-27 01:01:12

Re: All of them - ArchivEE

#34 2022-01-21 07:12:05

Re: All of them - ArchivEE

#35 2022-02-18 20:29:15

Re: All of them - ArchivEE

#36 2022-03-25 06:36:00, last edited by N1KF (2022-03-25 07:05:25)

Re: All of them - ArchivEE

#37 2022-08-28 20:37:44

Re: All of them - ArchivEE

ArchivEE 2: Electric Boogaloo

#38 2022-08-28 20:57:38

Re: All of them - ArchivEE

#39 2022-08-31 05:52:54

Re: All of them - ArchivEE

#40 2022-08-31 06:33:11

Re: All of them - ArchivEE

#41 2022-09-02 14:43:24

Re: All of them - ArchivEE

#42 2023-01-29 13:41:54

Re: All of them - ArchivEE

#43 2023-01-31 08:32:29

Re: All of them - ArchivEE

#44 2023-02-03 03:42:40

Re: All of them - ArchivEE

#45 2023-02-08 18:54:11

Re: All of them - ArchivEE

#46 2023-02-10 08:51:29

Re: All of them - ArchivEE

#47 2023-08-15 06:12:46

Re: All of them - ArchivEE

#48 2023-10-01 04:25:00

Re: All of them - ArchivEE

#49 2024-04-04 23:49:50

Re: All of them - ArchivEE

#50 2024-04-20 02:18:31

Re: All of them - ArchivEE

Board footer