Autor Thema: Stats for Opencaching sites  (Gelesen 414 mal)

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Stats for Opencaching sites
« am: 28. Januar 2020, 03:28:20 »
Hi,

I'm developing a tool to compute various statistics related to Opencaching activity and a cache map. It supports all OC sites which use OKAPI. The tool itself is accompanied by a simple webpage to visualize the results and you can check it out here: http://tomaszg.pl/geo/.

It is still work in progress and especially all international features were not extensively tested. Myself, I use only OC.pl so many things may break. Also I still intend to add new features, so all ideas are welcome.

If anyone is interested to contribute, the source code is hosted at https://gitlab.com/tomaszg/geostat.

Offline mic@

  • Moderator
  • Large
  • *****
  • Beiträge: 6345
  • oc-only Verstecker
Re: Stats for Opencaching sites
« Antwort #1 am: 28. Januar 2020, 06:25:29 »
Hi Tomasz, it seems that this year 2020 ist the year of statictics.
We have already two statictics for oc.de available ;)

Regarding Your website: My nick (mic@) is not accepted:
==> Incorrect characters in nick d.

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Re: Stats for Opencaching sites
« Antwort #2 am: 28. Januar 2020, 06:44:19 »
Regarding Your website: My nick (mic@) is not accepted:
==> Incorrect characters in nick d.

Ah, didn't expect a "@". Should work now.

BTW. Your German language question captcha is a bit annoying ;)

Offline mic@

  • Moderator
  • Large
  • *****
  • Beiträge: 6345
  • oc-only Verstecker
Re: Stats for Opencaching sites
« Antwort #3 am: 28. Januar 2020, 06:54:27 »
Zitat von: tomaszg
Ah, didn't expect a "@". Should work now.

Wow, thx for the fast reaction.
The statistic is very beautiful !!!

Is there a chance to get an overall statistic, for example a heatmap of ALL oc.de users?

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Re: Stats for Opencaching sites
« Antwort #4 am: 28. Januar 2020, 10:29:26 »
Is there a chance to get an overall statistic, for example a heatmap of ALL oc.de users?
Do you mean just a heatmap of cache locations or heatmap of finds? In any case OKAPI doesn't allow it easily. It limits the amount of data user can pull. I would have to clone the database on my end and work with it. I'm doing that for OC.pl to plot caches not found but it is slow and requires storing the data locally on my server. I could try to do it. For OC.pl it is easy to get the cache heatmap by checking "not found" toggle and specifying a user without any finds (or with minimal one).

BTW. I just realized that OC.de hosts a lot of "Safari" reverse caches. I should probably try to exclude them from geographic part of stats. Too bad they don't have a separate cache type... I explicitly excluded "own" and "mobile" type of caches already.

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Re: Stats for Opencaching sites
« Antwort #5 am: 28. Januar 2020, 14:02:13 »
I downloaded the data dump and rendered a cache density heat map:




Offline mic@

  • Moderator
  • Large
  • *****
  • Beiträge: 6345
  • oc-only Verstecker
Re: Stats for Opencaching sites
« Antwort #6 am: 28. Januar 2020, 21:31:38 »
Zitat von: tomaszg
Do you mean just a heatmap of cache locations or heatmap of finds?

Correct.
So the result would be something like this here:
http://www.flopp.net/heatmap
Unfortunately this heatmap is only for caches, not for finds.


Zitat von: tomaszg
BTW. I just realized that OC.de hosts a lot of "Safari" reverse caches. I should probably try to exclude them from geographic part of stats. Too bad they don't have a separate cache type... I explicitly excluded "own" and "mobile" type of caches already.

All safari caches have a specific attribute.
Maybe this could help for building the right filter.
And "maybe" we will fix this problem soon, because there is the idea of
simplifying the cache types (e.g. remove math caches and introduce safari cache).

Your maps look great - thank You very much!
« Letzte Änderung: 28. Januar 2020, 21:43:29 von mic@ »

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Re: Stats for Opencaching sites
« Antwort #7 am: 29. Januar 2020, 18:41:33 »
Correct.
So the result would be something like this here:
http://www.flopp.net/heatmap
Unfortunately this heatmap is only for caches, not for finds.
If I find the time, I'll try to prepare something for finds. I'll probably only upload a generated image, but it might be fun to create a web interface to be able to trace geocaching activity in a given time period.

All safari caches have a specific attribute.
Maybe this could help for building the right filter.
And "maybe" we will fix this problem soon, because there is the idea of
simplifying the cache types (e.g. remove math caches and introduce safari cache).
I noticed that. My code is not yet ready to handle attributes but when it does I'll try to filter them out.

Offline FriedrichFröbel

  • Vereinsmitglied
  • Micro
  • *
  • Beiträge: 476
  • OC-Wiki Admin
Re: Stats for Opencaching sites
« Antwort #8 am: 01. Februar 2020, 10:46:49 »
By the way: It seems like umlauts are not allowed inside the user name as well at the moment.

Offline tomaszg

  • Aktive User
  • *
  • Beiträge: 6
Re: Stats for Opencaching sites
« Antwort #9 am: 01. Februar 2020, 11:59:52 »
Now it should work. I managed to get better unicode support in my web script and I hope I didn't break anything else by doing that.