Danbooru

Wiki Page Gardening Project

Posted under General

Intro

Basically, all Wikis have IN-links and OUT-links. OUT-links are created whenever you add a [[wiki entry]] to a wiki page and are easy to determine. IN-links are whenever another wiki has one of those OUT-links to that page, and are much harder to determine.

The more networked the wikis are (i.e. more links between each other), the easier is will be to find information and related information on tags. It works the same way with the internet. A site that has no links to it in general will rarely be visited.

Lists and tag groups

For reference and potential candidates for tag inclusion.

Data

The following table represents the General category wikis that have no IN-links from any other wiki entries. It does not include *_(cosplay) wikis or wikis from tag aliases (i.e. antecedent name).

Note: The cutoff for the above table was 50 active posts

To Do

  • Go through and start adding wiki links in other wikis that link to the above wikis where it makes sense (Partially accomplished, switched it to character table for now...)
  • Do the same for character and copyright wikis (not artist wikis since they very rarely need IN-links)
  • Investigate the "below 50 active posts" cases for all applicable categories
  • Investigate wikis with only deleted posts
  • Investigate wikis with no posts whatsoever
  • Investigate Dead links - entries linking to nonexistent tags.(Partially done... Completed ID 30000 and above)
  • Investigate Outdated links - entries linking to tags that have since been aliased. These links should be updated to point to the new tag.
  • Investigate Renamed links - entries linking to tags that have been renamed, but not necessarily aliased. These links should be updated to point to the new tag. (Completed: 1 Year of Wiki Page versions)
  • Investigate Outdated wikis - tags that have been aliased to something else, but that still have a wiki entry. These entries need to be migrated or merged, then deleted.

Raw data

Edit:
2017-02-09
  • Added some header section links
  • Updated tasks
2017-02-09
  • Updated the table
  • Added raw data as JSON files
  • 2016-11-06
  • Changed the table to character table and restricted it to a more manageable 200 entries
  • Updated what tasks have been accomplished since last update
  • 2016-10-09
  • Added related tags to table
  • Added lists and tag groups
  • Added evazion's list of To Do's <forum #121099>
  • Changed title
  • Updated

    Thanks for doing this, I had been wondering about unlinked entries too. I went through starting from the bottom up and linked up some random ones. The wiki in general is highly neglected and could use a lot of gardening.

    Some other things that might be worth investigating:

    • Dead links - entries linking to nonexistent tags.
    • Outdated links - entries linking to tags that have since been aliased. These links should be updated to point to the new tag.
    • Outdated wikis - tags that have been aliased to something else, but that still have a wiki entry. These entries need to be migrated or merged, then deleted.

    Thanks for that. I started from the top but have only gone through the first 20 entries since some I've been trying to thoroughly link some of the pages that I come across (plus I try to avoid burnout)...

    I'll add your ideas to the original post as To Do items.

    So then, that means that antecedent alias tags with wikis need to have their wikis merged with the consequent tag then deleted...? I always thought those wikis were left around for... reasons...? *SHRUGS*

    Updated

    I don't know if there are any good reasons to keep them around. I think most were just forgotten to be moved when a tag was aliased.

    And I realized this one can be found via BigQuery. So here we go, general tags that have been aliased but that still have a wiki entry:

    The length columns indicate the size of the old entry compared to the new one.

    If the new length column is empty, then that entry doesn't exist. The old one needs to be moved to it.

    If the old length column is zero, then the wiki entry is empty. It can safely be deleted. EDIT: Err, wait, some still have pixiv tags that need to be moved.

    Went through all of the colors and more of the orphan wiki page list, before stopping to create a List of Meta-Wikis, listing every meta page, such as tag groups, lists, pool groups, etc.

    Compiled a script that will go through a wiki page and accentuate the wiki links according to the following scheme.

    Legend:
    Post count > 20000: underline, bold & italics
    Post count > 5000 tags: bold & italics
    Post count > 500 tags: bold
    Post count == 0: surround with []
    No wiki: surround with {}, links to tag search
    Invalid tag: strikethrough, link removed

    Take a look at List of original characters for an example. It provides visual feedback on the page for any user to fix/update at their discretion. Please provide any feedback on the look of it.

    I'll give it a day or so before I start processing the other meta-wiki entries.

    Updated

    Linked the list of meta-wikis in help:home since it's quite useful, thanks for compiling that. I'll work on the unlinked characters list starting from the bottom up.

    Re: styling wiki links by post count, honestly I'm not a fan of that. I know it's the convention in some meta wikis but I feel it adds noise to the page. Plus usually small tags are the ones I'm more interested in, not the large ones. My userscript adds post count classes to tags so this styling can be done in CSS, although of course that only benefits the few people running the userscript.

    Yeah, I've only done it piecemeal so far. The main benefit is that it styles up the page so that it's instantly obvious which links don't have wikis/posts.

    If CSS classes do ever get enabled for wiki links, it'll be easy enough to go back and remove the hard-coded stylings...

    Updated the opening post and also added in the raw data. The raw data for the foundwikis JSON is particularly interesting. With it, you can find out every wiki that points to any particular wiki. This is very useful when changing the name of a wiki. You can easily find all of the entries that need fixing in other wikis.

    Also, I don't know how resource intensive this would be, but would it be beneficial to have a regularly updated database (daily) that could be queried and return the same information in the foundwikis JSON...? Another use case is that if Danbooru detects that you're changing the name of a wiki, it'll automatically pop up the latest list of wikis that will need to be updated as well.

    Thoughts?

  • 1