News
Tweaked the auto black border cropping function
9 Feb 2021

Added a toggle border crop button in case you do not like the border cropping function, you can turn it off.
- black level threshold is lowered, so dark grey backgrounds are not over-cropped
- always crop a little bit inwards than the detected black borders (to cut away anti-aliasing / bleeding edges)
cutting away a little bit more borders from a dark image would not affect much of accuracy, they are of similar colors anyway
but leaving an excess black border on a bright image would affect accuracy a lot, so cutting a little bit more seems better

Website updated to use new trace.moe API
9 Feb 2021

- the API is now served by the 96 core servers on cloud
- front end code rewrite with ES6+ syntax. Dropped IE and some old browsers support.
- safe search button is removed, it shows only when NSFW results are found
- search will now perform first 3 trials at once (in DB), you will no longer see results appearing one after another
- the candidate size is now set automatically on server side. If it finds that some search results are trimmed, it would increase candidate size and search again. This is done entirely on server side.
- keep searching button removed. I'm pretty sure you can no longer find relevant results with that function.
- Flip button removed. (caused many bugs in website, before I add this back, please flip the image on your own.)
- JCD algo button removed. (will add this back after migration complete, you can still use this algo via trace.moe API)
- loop/autoplay/mute button removed. (I may add back an unmute button if possible)

Updates to trace.moe API
30 Jan 2021

- Change: image preview endpoint has changed, the url is now consistent with video preview
- New: size param for image/video preview

Please refer to https://soruly.github.io/trace.moe/#/#previews

trace.moe database dump 2020-10
18 Oct 2020


This is the most recent database dump for trace.moe which contains image hashes of ~5000 anime titles. (No video files included)

Comparing to last DB dump, this data set has recent anime added, and has replaced many subbed versions with raw anime.

These can be loaded into sola database for searching locally. You can follow the project on GitHub if you are interested.

https://github.com/soruly/sola

New Image Search Algorithm (JCD)
13 Apr 2020

A new search algorithm has been added to trace.moe. You can try this using the "Use new algo" check box near the search button. This new algorithm has better support on flipped and cropped images. See results above.

This new algorithm still needs fine-tuning of its parameters, so I'm now opening this option for everyone to try. For developers using the API, you can use /search?method=jc . In upcoming months, I'll review the performance and accuracy of these two algorithms and see if JCD is good enough to replace ColorLayout. Or else, methods to combine the two.

The new algorithm, JCD (Joint Composite Descriptor) is composed of CEDD (Color and Edge Directivity Descriptor) and FCTH (Fuzzy Color and Texture Histogram), takes both color, edge (shape) and texture into image analysis. trace.moe has been using ColorLayout descriptor, which does not analyze the image edge and shape but only the distribution of colors in a 8x8 grid. With this new algorithm, it makes it possible to search for flipped/cropped images which previously fails.

Note that none of these Image Descriptors are invented by me. If you're interested in the principles of the the algorithm(s), please read the paper from the original author. and its open source implementation, LIRE.

When indexed on the same video data set, the size of indexed database (extracted) is 232GB, 85% larger than that of ColorLayout (125GB). The database cache of two algos and memory for apache solr now occupies 420GB RAM (out of 512GB) RAM on server.

Serving the database for the new algorithm requires powerful servers. Please continue to support this project for ACG fans! :3

trace.moe database dump 2020-04
13 Apr 2020

This is the most recent database dump for trace.moe which contains image hashes of ~100,000 anime files. (No video files included)

Comparing to last DB dump, this data set has recent anime added and versions from different subgroups de-duplicated. For most anime, only one version of the same episode is kept in db. This results a smaller database size and faster search time.

These can be loaded into sola database for searching locally. I'm still modifying sola and document the the steps how to do so. You can follow the project on GitHub if you are interested.

https://github.com/soruly/sola

Added dark theme support
14 Sep 2019

If your OS is in dark mode, it would switch to dark mode automatically without any settings.
For windows, it'd be in settings => personalization => color
For macOS, it'd be in system preferences => general => appearance

Added image URL support to trace.moe API
4 May 2019

You can now easily use http://trace.moe API directly with image URL

https://soruly.github.io/trace.moe/

trace.moe database dump 2019-04
4 May 2019

This is the most recent database dump for trace.moe which contains image hashes of ~100,000 anime files. (No video files included)

These can be loaded into sola database for searching locally. I'm still modifying sola and document the the steps how to do so. You can follow the project on GitHub if you are interested.
https://github.com/soruly/sola

Optimizing website loading speed
1 May 2019

Recently I've been improving webpage loading times in various ways:
- Re-write webpage js to remove heavy libraries like jQuery / bootstrap.js
- Use HTTP/2 Push to reduce round-trip times
- Upgraded Cloudflare CDN to pro plan ($20/month)

Now the webpage can complete loading in just 90ms!! (from regions close to origin server)

trace.moe is now scoring 98 and 100 in Google PageSpeed Insights.

I've also improved website security to score A+ (115/100) in Mozilla Observatory test.

Recently I've found that Cloudflare's free plan did not route to nearest edge server due to it's network capacity. When traffic is busy for the region during that period, it may route to thousands of miles away which increase page load time by hundreds of milliseconds. That's why I've upgraded to Cloudflare pro plan to ensure the website is consistently fast from the whole world. I hope your support can cover the increased cost.

Recent updates to trace.moe
3 Feb 2019

New web UI layout for mobile devices!
A few days ago, I redesigned a the webpage layout a bit to better support mobile devices. (finally!) Though the layout isn't very perfect, at least it's easier to use and browse compared to the fixed viewport before. Try the webpage now at https://trace.moe

Natural Scene Cutter for video preview
I started a new project late October 2018 to cut video scene previews naturally, by detecting timestamp boundaries of a scene. This method is better than the fixed time offset cutting. So you can loop the video of the scene. I'm still writing description of this project, which you can find it on Github https://github.com/soruly/trace.moe-media

GIF Preview for Telegram bot
To try the natural scene cutter, you can use the Telegram bot.
https://telegram.me/WhatAnimeBot
Send an image with caption "mute", and it will return a muted video preview (same as GIF), which can loop a scene.

API updates
The natural scene cutter can also be used via API now.
The API and API docs have updated to resolve some confusions around search image format and error handling issues. Now the API has removed strict restrictions on image format and is supporting both JSON and FORM POST. Details are written in https://soruly.github.io/trace.moe/

Dockerizing sola
sola is now mostly dockerized. It is a lot easier for developers to setup their own video scene search engine now. Instructions are written in details in the project:
https://github.com/soruly/sola


The domain incident hit this project quite hard last October. But with the help of fans and developers around the world, the daily search queries has now restored to same levels as half a year ago. Thank you for all your support!! ;)

Moving to new domain: trace.moe
22 Oct 2018

Yesterday, the .ga domain provided by Freenom (domain name registrar) was suddenly suspended. I had no choice but immediately moved to trace.moe which I've been planning to move to.
As of today, officially supported integrations (WebExtensions, Telegram bot), and some major integrations (Discord, SauceNAO) has been updated to the new domain. In upcoming days I'll work with developers of remaining 3rd party integrations (including API users) to notify the change.

Why the name trace.moe?
This search engine tells you more than the anime name, but actually trace back the moment of the scene. And quite a number of users actually need "time tracing" even they already know the anime. That's why I think using "trace" instead of "whatanime" better describes this search engine.

open sourcing scene search with sola
2 May 2018

The last piece of puzzle in whatanime.ga has published.
The whatanime repository on GitHub has gain lot of developers' attention. However, it only include the code for the website and is not a fully functional system. Some of them are puzzled when they try to look into the code.

Last month, I've re-written those messy scripts into a new project - sola.

This include all the scripts that whatanime.ga currently used to put mp4 video files into solr for search. It has been running for a month, so this should be stable enough to publish. sola is not limited to searching anime, any types of video (like movies, TV shows) can also be indexed. It does not depends on whatanime and anilist, the only dependeny is liresolr. So users that doesn't need anime info and web UI can avoid those complexities.

sola is a node.js app. Many developers would feel easy to read and modify the code. Hopefully this would encourage contribution to the project. It has just ~700 lines of code in total. For developers that doesn't like Javascript (or would like to avoid GPLv3), it's not difficult to rewrite the whole thing.

I've written a setup guide for developers to easily setup their own video scene search engine. Spread the news to developers and let them try!

https://github.com/soruly/sola

Speeding up search on whatanime.ga
2 Apr 2018

https://youtu.be/HjL5O3k3C7s

New testing site on https://beta.whatanime.ga
I've been testing a new beta site with improved performance on search speed.
A copy of the 130GB solr core from http://whatanime.ga is split into 10 smaller cores (10-16GB each, with 59-89 million hashes). Each search queries all 10 solr cores in parallel and then merge back. Early tests shows that it can query 950 million image hashes in 1.35 seconds! Almost 10 times as much than the existing one.

I've rewritten a lot of backend scripts into a nice CLI tool. I'm going to publish it on github later this month, after I've completed the docs and tutorial. For experienced developers, it will be a lot easier to setup their own video reverse search engine.

Added auto black border crop
13 Nov 2017

This will automatically detect and crop black borders on search image, significantly increase the accuracy on bad screenshots
This is applied to both web, telegram bot and all API clients
This is achieved by openCV using a simple python script

Telegram Channel
26 Aug 2017

You can subscribe the Telegram Channel for database and news updates.

GIF and video support for Telegram Bot
24 Aug 2017

You can now send GIF or video to the Telegram Bot.

Group chat support for Telegram Bot
23 Aug 2017

You can now add the Telegram Bot to Telegram group. Use @ to mention the bot on any photo to search.

Fix search requests failed when Google Analytics is blocked
5 Aug 2017

Identified and fixed an issue where browsers failed to search due to blocked scripts.

Added 2017-04 database dump
26 Jul 2017

Database dump updated to 2017-04.

Added demo for the upcoming search engine update
14 Jun 2017

Take a look at a demo on demo.whatanime.ga

New Icon
5 Jun 2017

favicon
This is the new icon for whatanime.ga

2017 Presentation slides updates
4 Jun 2017

Want to know more about whatanime.ga? Read the Presentation slides on June 2017.

Search changes
30 Apr 2017

You can now search scenes with any aspect ratio. Thumbnail preview also respect aspect ratio now. Recaptcha is removed, you must wait up to 10 minutes once you have reached search quota limit (20 search per 10 minutes). Homepage code has been re-written, the webpage now loads faster. And a new loading animation was added.

Search for more results
23 Apr 2017

You can now keep searching the database for more results. Previously, the search would stop when it has found any result > 90% similarity. Now keep searching to discover more results with even higher similarity!

Search in specific season
18 Apr 2017

You can now select a particular year / season to search. If you like this project, feel free to Support whatanime.ga on Patreon.

System maintenance
15 Apr 2017

Server upgrade and cleanup was completed on 15 Apr 2017. An additional hard drive and new network adapter has been installed.

System status page
14 Apr 2017

You can now see the system status in https://status.whatanime.ga (Powered by UptimeRobot).

Partial service interruption
23 Feb 2017

Anime info panel was not showing since Feb 21 21:13 UTC , the service has been restored on Feb 23 03:34 UTC.

Image proxy relocated
21 Feb 2017

The image proxy server has been moved from Singapore (Digital Ocean) to Tokyo (Linode). It may affect loading times of images from ?url= params.

Video preview for Telegram Bot
4 Feb 2017

The Telegram Bot will now sends you a video preview.

Official API released
17 Jan 2017

The official API is now open for testing. Interested developers may read the page on GitHub Pages.

WebExtension updated
16 Nov 2016

The image extraction method of WebExtension has changed. This would be able to fix some issues on grabbing the correct image on webpage to search. Now the Extension also supports Microsoft Edge. You may try loading the zip from GitHub by enabling extension developer features in about:flags.

Enabled autoplay on mobile
11 Nov 2016

Now mobile devices will mute and autoplay the video preview.

Added URL params for playback options
29 Oct 2016

You can now use URL params to control playback options, for example:

https://trace.moe/?autoplay=0&loop&mute=1&url=
Improved performance
23 Oct 2016

Reduced search result candidates from 10 Million to 3 Million. This would reduce accuracy but greatly improves performance.

Added links to database dump
5 Oct 2016

You can now download a complete dump of the database.

Added more server status
1 Oct 2016

You can see server load and recently indexed files in /about

Adding Raw Anime
1 Oct 2016

The database has started indexing raw anime from now on.

Added Telegram Bot
14 Sep 2016

This telegram bot can tell you where an anime screenshot is taken from. Just send / forward an image to https://telegram.me/WhatAnimeBot .

WebExtension Changes
14 Aug 2016

The ?auto url param is no longer used. Now it would always automatically search.

WebExtension has updated. Now it would copy and paste using dataURL in background. It allows searching images from pages that's not publicly available such as Facebook Feeds. It also supports searching from HTML5 videos using the frame extracted at the moment you click it. Now extensions no longer use the ?url to send search images.

WebExtension for Chrome, Firefox and Opera
1 July 2016

Chrome Extension, Firefox Add-on, Opera Add-on has been relased.
Source code available on GitHub

Improved anime title language
30 Jun 2016

It now shows anime titles according to users' browser language.

Added loading icon
30 Jun 2016

It now shows a loading icon (instead of blurring) while searching. Also display a loading icon when the video preview is loading.

Added preview thumbnails
30 May 2016

The thumbnail may not be at the exact moment, since the seeking is not very accurate. Play the preview to see if it's what you are looking for.

Fixed some bugs in URL loading
6 May 2016

In case the image cannot be loaded, upload the image from file or copy image itself (not URL) then Ctrl+V

Speed up image load from URL
23 Apr 2016

Images load from URL would be compressed. This would speed up loading GIF and large images from URL.

Performance Tweaks
18 Apr 2016

Server will now cache some search results. Search results would be cached for 5-30 minutes. The better the search results, the longer the results would be cached.

Updated Chrome Extension
8 Apr 2016

Once the image completes loading, it would search automatically. You can change the setting in Chrome Extension. Also see how you can search in Firefox in FAQ.

Added index cache status
7 Apr 2016

You can now see how much data is cached in RAM from About page. The higher the percentage faster the search. It usually stays around 33% due to limited RAM.

Incorrect timestamp issue identified
6 Apr 2016

There has been some incorrect timestamp in search results due to image analyze scripts parsing outputs of ffmpeg incorrectly. The script has been updated now. From now on new animes should have a correct timestamp, while it would take at about two months to fix already indexed animes. The new script is also 33% faster when indexing anime.

Fixes some image editing issue
10 Mar 2016

Image would sometimes gone black when clicking fit / flip button. Now fixed.

Added Fit Width / Height option
6 Mar 2016

You can now choose to Fit Width / Height for your search image. Also fixed some flickering issue on previews.

Fixed some Image URL issue
3 Mar 2016

Fixed some cross-site image URL linking issue. Most image URL should load now.

New Anime Info Panel UI
1 Mar 2016

A better layout for more Anime information.

Added Image URL Option
1 Mar 2016

You can now search by Image URL

Added Safe Search Option
28 Feb 2016

The Safe Search Option can hide most Hentai Anime from search result. But you should aware that some regular season Animes can still be obscene. (NSFW)

Try the Chrome Extension
28 Feb 2016

Now you can use the Chrome Extension to search.

Added some Heitai Anime
28 Feb 2016

About 168 Heitai Anime series has been added.

Added sample screenshot in FAQ
28 Feb 2016

To help users to understand how the search engine works, we have added some good and bad screenshots in FAQ.

Performance Improvement
21 Feb 2016

Improved caching method to warmup cold data.

More fixes
20 Feb 2016

Database has been cleaned up and reloaded. This should fix most video previews. Fixed some anime titles still being null.

Bug Fix
17 Feb 2016

Fixed the empty search result. The issue has been resolved. A large number of files has been relocated, video preview may be missing for some search results.

Improved Performance
01 Jan 2016

Increased cache size to improve performance when the server has been idle for a long time.

Added a Flip Button
31 Dec 2015

You may now flip the image before searching. If you can't find a match, try to flip your image and search again. (Especially useful for AMV)

Search Algorithm Changed
21 Dec 2015

Switched to use a new searching algorithm. The search is slower but more accurate.

Public Beta
19 Dec 2015

Adding some informative pages.