Official Everybody Edits Forums

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

[WIP] EEIndex - A searchable database of all EE levels and users.

EEIndex will be a searchable database containing nearly every level and user in Everybody Edits.
A program will continually scan the game searching for new users and updated levels.

As of now, I'm trying to properly run a master import of most users and levels in the game.
The next phase will be to complete the indexing software to scan the game for changes.
Lastly, I'll create an application to allow people to search through the content of the database.

CURRENT PROGRESS

May 07, 2015, 10:00 PM EST

▼Hidden text

Searching each user in the game for their levels, as well as creating an accurate username/user id map.

May 07, 2015, 11:30 PM EST

▼Hidden text

Populating database with a master index of users and levels.

May 08, 2015, 2:30 PM EST

▼Hidden text

The master index is complete, with a total of 1,019,069 users and 882,268 levels.

mrjawapa

Corn Man 🌽

From: Ohio, USA

Joined: 2015-02-15

Posts: 5,840

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

913443 worlds (as of yesterday).

Anyway, nice!

---

Discord: jawp#5123

italkalotfromee

Member

Joined: 2015-05-08

Posts: 117

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Nice and good luck too you mate.

- We was just talking about this.

---

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

913443 worlds (as of yesterday).

Anyway, nice!

I found 884139 levels. Although, Processor did tell me that open worlds have an object for some reason. Plus, I can't those few bot-created levels made by people.

Regardless, I'm now importing levels and users into the database!

Mylo

Master Developer

From: Drama

Joined: 2015-02-15

Posts: 829

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

What's about the people who don't want to be included?

---

https://m-k.io

den3107

Member

From: Netherlands

Joined: 2015-04-24

Posts: 1,025

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

What's about the people who don't want to be included?

I don't think there's a policy in EE that counters that.
I assume Irussell's tool can't find any hidden rooms, so those would still be safe.

Another example of where I'd like to be excluded but simpyl can't:
There's this skin browser for Minecraft, where you just insert a username and you can download his/her skin.
There is no policy in Minecraft that counters this, as is this simply a sped up version of making screenshots of the skin in-game and reconstructing it manually.

Same with this tool, in the end you'll be able to find all rooms this tool gives you, it just speeds things up and makes things easier.

den3107

Member

From: Netherlands

Joined: 2015-04-24

Posts: 1,025

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Also, roomcode "PWAAS2bkmLa0I" will most likely be seen as not having any owner.
This is an old room of mine (some might remember Pirate Boss) but has bugged and now... Well... When I join the room it has no room and no content.

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

What's about the people who don't want to be included?

I don't think there's a policy in EE that counters that.
I assume Irussell's tool can't find any hidden rooms, so those would still be safe.

Another example of where I'd like to be excluded but simpyl can't:
There's this skin browser for Minecraft, where you just insert a username and you can download his/her skin.
There is no policy in Minecraft that counters this, as is this simply a sped up version of making screenshots of the skin in-game and reconstructing it manually.

Same with this tool, in the end you'll be able to find all rooms this tool gives you, it just speeds things up and makes things easier.

I'm able to find every level any user owns, even if their profile is hidden. I'll try to respect hidden levels, but it does make it a lot more difficult because I did plan on releasing a downloadable copy of the entire database. Even so, I couldn't stop the determined from finding a level (because they could just find them through the source I use).

Mylo

Master Developer

From: Drama

Joined: 2015-02-15

Posts: 829

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

I just wanted to add that viewpoint, though.

It's a tool which makes it easier.
As example, I wouldn't even know how to do this if I wouldn't do deeper research on this topic -
but with this - I can skip that hurdle, and just do it.

Even if it's allowed by the policy of EE, there should be something called morality and respect.
That's why I am glad you're trying to add this. :)

---

https://m-k.io

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

I just wanted to add that viewpoint, though.

It's a tool which makes it easier.
As example, I wouldn't even know how to do this if I wouldn't do deeper research on this topic -
but with this - I can skip that hurdle, and just do it.

Even if it's allowed by the policy of EE, there should be something called morality and respect.
That's why I am glad you're trying to add this.

I just updated the database columns to reflect some newly added things I missed (hidelobby, allowspectating). If a level is set to be hidden from the lobby, I won't allow it in search results. Also, yesterday I ran into a duplicate bug which I didn't fix until a few minutes ago. The import into the database has been restarted.

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Below is an example of the data stored for the levels a user owns.
Check the OP post for a little more info on the update.

Hexagon

Member

Joined: 2015-04-22

Posts: 1,213

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

---

???

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

Hexagon

Member

Joined: 2015-04-22

Posts: 1,213

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

---

???

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

Regardless, I'm going to need to find time rather soon so I can begin to actually keep that database current. I haven't really done enough work on that part yet.

Psychocrysma

Member

Joined: 2015-02-26

Posts: 46

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

Assuminghe he uses SQL Database, which is probably the case.

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

Assuminghe he uses SQL Database, which is probably the case.

Yes, I do. I thought phpMyAdmin would have given that away.
My database experience is limited though, so I'm learning at the same time.

Also, it would be:

SELECT * 
FROM  `levels` 
WHERE  `hidelobby` =0
AND  `visible` =1

Psychocrysma

Member

Joined: 2015-02-26

Posts: 46

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

You should release daily dumps/your entire database, because it would help the community create and derive works thereof.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

Assuminghe he uses SQL Database, which is probably the case.

Yes, I do. I thought phpMyAdmin would have given that away.
My database experience is limited though, so I'm learning at the same time.

Also, it would be:

SELECT * 
FROM  `levels` 
WHERE  `hidelobby` =0
AND  `visible` =1

Well, that, I was aware. Since bools and stuff cannot be used (if I remember correctly)

That said, I don't program in PHP. Programming is for me only a hobby. Since I don't need PHP, I don't learn it. When I'll need it, then I'll learn it.

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Problem is, I'll then have to actually filter out specific levels from the database to maintain privacy for users.

select * from lrussell_words where hidelobby != 1 and visible != 1

Assuminghe he uses SQL Database, which is probably the case.

Yes, I do. I thought phpMyAdmin would have given that away.
My database experience is limited though, so I'm learning at the same time.

Also, it would be:

SELECT * 
FROM  `levels` 
WHERE  `hidelobby` =0
AND  `visible` =1

Well, that, I was aware. Since bools and stuff cannot be used (if I remember correctly)

That said, I don't program in PHP. Programming is for me only a hobby. Since I don't need PHP, I don't learn it. When I'll need it, then I'll learn it.

My project doesn't use PHP at all (at least yet). phpMyAdmin is a database administration software.
Also, you can use bools in PHP.

den3107

Member

From: Netherlands

Joined: 2015-04-24

Posts: 1,025

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

▼Previous quotes

select * from lrussell_words where hidelobby != 1 and visible != 1

Assuminghe he uses SQL Database, which is probably the case.

Yes, I do. I thought phpMyAdmin would have given that away.
My database experience is limited though, so I'm learning at the same time.

Also, it would be:

SELECT * 
FROM  `levels` 
WHERE  `hidelobby` =0
AND  `visible` =1

Well, that, I was aware. Since bools and stuff cannot be used (if I remember correctly)

That said, I don't program in PHP. Programming is for me only a hobby. Since I don't need PHP, I don't learn it. When I'll need it, then I'll learn it.

My project doesn't use PHP at all (at least yet). phpMyAdmin is a database administration software.
Also, you can use bools in PHP.

I think he meant booleans in the SQL queries.

Also, smart save with the "yet" there, since obviously the website or whatever will require PHP to read the database.

Hexagon

Member

Joined: 2015-04-22

Posts: 1,213

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

I think he meant booleans in the SQL queries.

Booleans can be used in PHP and SQL.

[...]will require PHP to read the database.

It doesn't have to be PHP that reads the database, it could be any web-supported framework.

---

???

lrussell

Member

From: Saturn's Titan

Joined: 2015-02-15

Posts: 843

Website

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

I think he meant booleans in the SQL queries.

Booleans can be used in PHP and SQL.

[...]will require PHP to read the database.

It doesn't have to be PHP that reads the database, it could be any web-supported framework.

I was actually considering a standard .NET application for searching information for ease of interface design as well as for the ability to tie into live EE resources. Honestly, I'm terrible when it comes to web design. Hopefully by the end of this weekend I'll have the software running to keep the index up to date.

Hexagon

Member

Joined: 2015-04-22

Posts: 1,213

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Lrussell and I teamed up to create EEIndex. Here's a sample (it's far from finished): http://104.131.37.92/?name=minigames

If a minimap is just a grey blob just wait and it'll appear. I'm not sure if I'm allowed to post this link, because I didn't tell lrussell yet (oops.)

---

???

ewoke

Member

Joined: 2015-02-20

Posts: 412

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Lrussell and I teamed up to create EEIndex. Here's a sample (it's far from finished): http://104.131.37.92/?name=minigames

If a minimap is just a grey blob just wait and it'll appear. I'm not sure if I'm allowed to post this link, because I didn't tell lrussell yet (oops.)

Connection failed: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)

---

if you can read this....good for you

Hexagon

Member

Joined: 2015-04-22

Posts: 1,213

Re: [WIP] EEIndex - A searchable database of all EE levels and users.

Connection failed: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)

Thanks for finding out that glitch! I fixed it, and the minimap generation was the problem. They now load much much faster, and the MySQL error shouldn't appear.

---

???