Official Everybody Edits Forums

LukeM

Member

From: England

Joined: 2016-06-03

Posts: 2,981

Website

All of them

This is an archive of every single EE world containing content from the point at which the game was shut down, as well as a large collection of metadata to help you search for the worlds you want.

Download: ArchivEE (moderately large download, ~1GB)
Source: https://gitlab.com/LukeM212/ArchivEE/
ArchivEE C# library: https://www.nuget.org/packages/ArchivEE/

The download includes the ArchivEE database (ArchivEE.sqlite3) and a tool to search through it with versions for Windows (ArchivEE.exe), Linux (ArchivEE_linux), and MacOS (ArchivEE_macos). The ArchivEE library is available from NuGet and provides EFCore bindings for the database for if you want to access it programmatically. This comes along with a new version of the EELVL library which supports EELVL bundles and content-only EELVL serialisation (nuget, source).

How to use the search tool:
- When you open the tool, you will be prompted to start a 'query'. This is how you search for data in the database. The options you can pick will be listed, and to select one, enter its number and press enter.
- 'Start new query' starts a new query from scratch.
    - 'All' selects all entries. You will usually want to follow this with a 'Filter'.
    - 'By ID' asks you for a list of IDs, and returns the entries with those IDs.
    - 'By name' asks you for a list of names, and returns the entries with those names.
    - 'Custom SQL' lets you enter some custom SQL. This should be an SQLite "SELECT table.*" statement where the table name is the singular of the type of data, with underscores to separate worlds, e.g. Completed campaign worlds -> completed_campaign_world.
- 'Filter' filters the data you currently have selected depending on certain properties.
    - The options for what to filter by depend on what type of data you currently have selected.
    - Often it will prompt you for a range of values. These are inclusive, and if you want an open-ended range such as x >= 10, you should select 'none' for the end you don't need.
- 'Related data' selects another type of data related to the data you currently have selected.
    - This also depends on what type of data you have selected.
    - This selects every piece of data related to any entry currently selected in the way you select. For example, selecting 'Friends' when you have players selected will return all friends of any of the players in the selection.
- 'Continue earlier query' allows you to select an earlier query to continue.
    - This selects an earlier query to be continued.
- 'Combine with earlier query' lets you combine the currently selected query with a previous query of the same type.
    - 'X and Y' selects only the entries that were in both queries.
    - 'X or Y' selects any entry that was in either query.
- 'View result' lists the result of a query.
- 'Count resulting entries' counts how many results there were.
- 'Export worlds individually' exports each of the worlds in a query as .eelvl files.
    - This will prompt you for a directory to export all the eelvl files to.
    - It will export each world you have selected to this directory as an .eelvl file with the file name "world name - owner - world ID".
- 'Export worlds as bundle' exports the worlds in a query as an .eelvls bundle.
    - This will prompt you to select a 'default world'. This is the world you first join when you open the bundle in EEO.
    - This will also ask whether you want to 'remap' world portals. EEO uses integer world IDs based on the index in the world archive, e.g. the default world will have ID 0. This goes through and replaces all world portals pointing to a world in the archive with it's archive ID so that the world portal will work.

Example 1: Exporting all worlds that you own.

1. Start a new query

2. We want to load all worlds owned by a player, so first select 'Player' to find the right player

3. Enter the player you want to find (your username) then press enter twice to mark the end of the list

4. To check that you've selected the right player, you can run 'View result'. This should list some information about you

5. We then want to find all worlds owned by that player, so select 'Related Data' then 'Worlds'

6. We're finished with the query, so select 'Export worlds individually' and enter a folder to export to (e.g. 'output')

Example 2: Exporting all worlds that you have liked or favorited.

1. As before, start by selecting your player

2. To find all liked worlds, select 'Related data' then 'Likes'

3. To find all favorited worlds, select the earlier player query by selecting 'Continue earlier query' then 'Players by name', then select 'Related data' then 'Favorites'

4. To combine these, select 'Combine with earlier query' then 'Worlds liked by player' then 'X or Y'

5. Export the worlds as before

Example 3: Exporting all worlds created by any of your friends that have more than 250 plays.

1. As before, start by selecting your player

2. To find all your friends, select 'Related data' then 'Friends'

3. To find all worlds owned by those players, select 'Related Data' then 'Worlds'

4. To select only worlds with more than 100 plays, select 'Filter' then 'Play count', then enter '250' for the minimum, and 'none' for the maximum

5. If you want to make sure that you have written this query correctly, select 'View result'

6. Export the worlds as before

Example 4: Creating an .eelvls bundle of all worlds reachable through world portals from a certain world.

1. Select the starting world in some way, for example by using 'By ID'

2. To find all worlds reachable through world portals, select 'Related data' then 'World portal graph'

3. This doesn't include the original world itself if there isn't a world portal loop to get back to it, so select 'Combine with earlier query' then your original world query then 'X or Y'

4. To export these as a .eelvls file, select 'Export worlds as bundle', enter the name of the bundle file you want to create (e.g. 'output.eelvls'), select your original world as the 'Default world' (the world you start in when you open the .eelvls file), then opt to remap world portals so that they're recognised by EEO.

If you are familiar with SQL and want to run your own queries, for example to get statistics from the raw database, I would recommend installing https://sqlitebrowser.org/. This is a tool which allows you to view and run queries on an SQLite database. If you want to run these queries programmatically, I would recommend using C# with the EFCore and ArchivEE libraries, though any SQLite library should work.

▼Original post

A few of us are working on archiving every single EE world, I just wanted a place to direct people to that has all the information about how it's going. I'll keep this updated with how progress is going on each of the projects, and hopefully provide download links once they're available.

• Several people have full PlayerIO database exports. These contain everything required but are massive and are a pain to work with, so they'll need to be converted to some other format first.

• Atilla is attempting to get a copy of everything as TSON, which is much easier to work with.

• I've got a program which converts database exports to usable but incomplete eelvl files (missing the usernames of world creators and a few other things), either me or John will probably work on updating this so it produces complete levels over the next few days.

• There are several older projects to archive all worlds, the most notable probably being Atilla's original one, but others, I believe including N1KF and SirJosh, either had copies of or were working on getting copies of all worlds.

Updates:

• 2020-01-02: I've decided to put all the data I have into a database (using SQLite), which I'm currently in the process of doing, then once that's done I'll write a program to allow people to search through the archive and export any matching worlds as EELVLs. I'm hoping this will end up small enough that it could be put up for download somewhere so anyone can just download the whole thing, but if not I might either provide it to other people to host on a website, or work on improving the format it's stored in to get the overall size down.

Atilla's old archive: https://archive.org/details/EEWorlds

NoNK

Member

Joined: 2019-07-13

Posts: 618

Re: All of them

can we get a

TSON TO EELVL CONVERTER

N1KF

Wiki Mod

Joined: 2015-02-15

Posts: 10,214

Website

Re: All of them

others, I believe including N1KF and SirJosh, either had copies of or were working on getting copies of all worlds

To be clear, I've never made copies of all the worlds. I have (outdated) lists of world IDs from Capasha, and I had a JavaScript program to merge Atilla's EEWorlds into larger JSON files so my computer can actually handle sorting the data. So ultimately the data's the same as what Atilla had a while back. I don't remember if I finished the process, but I at least made it around halfway. Also, I think I downloaded a few thousand worlds once before EELVL files were a thing, but that's nowhere close to having a complete collection.

---

everybody edits FOREVER

Weirdoverse

Member

From: A Really Really Really

Joined: 2015-02-20

Posts: 1,040

Website

Re: All of them

Will the archive also include worlds from older world backups? For example I've had tons of worlds rebuilt in same 200x200 and 400x200 worlds in <2014 and i think other players might've done the same

---

A signature is a small piece of text that is attached to your posts. In it, you can enter just about anything you like. Perhaps you would like to enter your favourite quote or your star sign. It's up to you! In your signature you can use BBCode if it is allowed in this particular forum. You can see the features that are allowed/enabled listed below whenever you edit your signature.

soniiiety

Member

From: newzealand

Joined: 2016-02-10

Posts: 1,628

Re: All of them

apparently my acc is not in the archieve i asked on discord

---

..

LukeM

Member

From: England

Joined: 2016-06-03

Posts: 2,981

Website

Re: All of them

Progress on my version of the archive:

I've decided to put all the data I have into a database (using SQLite), which I'm currently in the process of doing, then once that's done I'll write a program to allow people to search through the archive and export any matching worlds as EELVLs.

I'm hoping this will end up small enough that it could be put up for download somewhere so anyone can just download the whole thing, but if not I might either provide it to other people to host on a website, or work on improving the format it's stored in to get the overall size down.

Will the archive also include worlds from older world backups? For example I've had tons of worlds rebuilt in same 200x200 and 400x200 worlds in <2014 and i think other players might've done the same

My one, no, but I think Atilla has an older one which has multiple versions of worlds.

apparently my acc is not in the archieve i asked on discord

It's possible that it's not in one of the other archives, but my one at least contains all (currently existing) accounts.

LukeM

Member

From: England

Joined: 2016-06-03

Posts: 2,981

Website

Re: All of them

Almost done with this now, I've managed to put everything in a database, and I've got a tool which lets you search through it using various criteria.

One thing I'm including is a list of all staff members so that you could search for something like "all worlds created by pre-2015 staff members" or whatever, but I'm missing a few of the dates, I'd be grateful if anyone could fill in any of the ones I haven't been able to find if you know them or know where to find them:

CJMAEDER developer start date
CYCLONE developer start date
KASLAI developer start date
KASLAI developer end date
KERFF developer start date
KERFF developer end date
ULTRABASS 2nd moderator end date
MINISAURUS original graphics designer start date
NOU moderator start date - If we don't get this one I'll just put down 2015/4/17 (his first forum announcement)
RPGMASTER2000 developer start date
RPGMASTER2000 developer end date
SHOWPATH developer start date
THESOURCE85 moderator end date
TIRALMO start date
TOBY developer start date
XJEEX developer start date
XJEEX developer end date

Idk if Satanya will allow jewel transfers, but if she does I'll give 40 jewels for each of these dates you can fill in! (Exact dates please, and ideally let me know where you got the information from so I can double check it)

Once these are filled in I think it should be pretty much ready to use, and it's looking like while it'll be moderately large (~1GB), it should be small enough to host somewhere so people can download the whole thing

Grilyon2

Member

From: Chile

Joined: 2015-02-15

Posts: 335

Re: All of them

https://forums.everybodyedits.com/viewt … p?id=44554 Minisaurus graphics designer start date, 2018-11-22

Kentiya

Member

From: United States

Joined: 2015-02-16

Posts: 1,084

Website

Re: All of them

One thing I'm including is a list of all staff members so that you could search for something like "all worlds created by pre-2015 staff members" or whatever, but I'm missing a few of the dates, I'd be grateful if anyone could fill in any of the ones I haven't been able to find if you know them or know where to find them:

CJMAEDER developer start date
CYCLONE developer start date
KASLAI developer start date
KASLAI developer end date
KERFF developer start date
KERFF developer end date
ULTRABASS 2nd moderator end date
MINISAURUS original graphics designer start date
NOU moderator start date - If we don't get this one I'll just put down 2015/4/17 (his first forum announcement)
RPGMASTER2000 developer start date
RPGMASTER2000 developer end date
SHOWPATH developer start date
THESOURCE85 moderator end date
TIRALMO start date
TOBY developer start date
XJEEX developer start date
XJEEX developer end date

Minisaurus joined 2018/11/21
Tiralmo joined 2018/10/10

Everything else was before Xenonetix's staff discord.

---

Kentiya // Alex — EE & EEU lead artist 2018-2020

LukeM

Member

From: England

Joined: 2016-06-03

Posts: 2,981

Website

Re: All of them

This is done!

Check the original post for the details for how to download and use the archive, and let me know if anyone has any problems, particularly either without .NET installed or on Linux or MacOS (I haven't been able to fully test these).

It's a console app because I couldn't be bothered to design 50+ different menus for each of the options, but I'm hoping I made it easy enough for people to use

N1KF

Wiki Mod

Joined: 2015-02-15

Posts: 10,214

Website

Re: All of them

Excellent. Now we shall make a website listing individual worlds and we will be one step closer.

---

everybody edits FOREVER

soniiiety

Member

From: newzealand

Joined: 2016-02-10

Posts: 1,628

Re: All of them

Excellent. Now we shall make a website listing individual worlds and we will be one step closer.

exactly

---

..