Free chess game database with over 11 million games (Scid vs. PC database format)

Sort:
Lumbra74

Hello Michael,

thank you very much for introducing my database, I really appreciate it! I have just uploaded the latest version with TWIC 1528.

In the near future I will also extract opening books from the database, in a similar way to the PGN files, and make them available on the website. To do this, however, I will have to change the menus again.

Best regards,
Michael/Lumbra74

charlemen

I especially like the addition of games from the Lichess Elite database and the chess transfer system. You can play here https://spacemanoyunu.net/ . This will certainly be a valuable addition to your already impressive collection.

vitualis

@Lumbra74: hey, I just noticed that on this page: https://lumbrasgigabase.com/download-the-scid-database/ the download link for the si4 file now only links to the update (5.68 MB 7zip file) rather than the full archive...

Lumbra74

Thanks for the hint. It should be fixed now.

Sorry for the inconvenience!

Lumbra74

A new version of the database (version 2024-02-27) was uploaded yesterday.

The database will be updated weekly, usually Tuesdays, after the release of the most recent TWIC file. The following files will be uploaded:

  • Database files (si5, si4 format)
  • A differential PGN-file containing the new games since release of the last database.
  • A monthly PGN-file, containing the new games
    • F.i.: The current database has been released on 02/27/2024. The last database of march will be released on 03/26/2024. These are 4 weeks, so the monthly update file will contain all weekly updates between the two releases. 
Lumbra74

I've created a blog post for future information:

https://www.chess.com/blog/Lumbra74/lumbras-giga-base-free-massive-game-collection-in-scid-and-pgn-format

mvk20

I'm visiting your site for the first time, and it says the database is being updated. Does that mean I should return in a few days to get the files? Thanks - this all sounds super helpful!

stevenaaus

Pretty decent blog. I went to the webpage, but it was "being updated". The ....chessok.com link is dead too.

If you're using less than six sources, instead of having an expensive extra tag, you may want to use the custom flags... Hmm , you probably have more than six sources, but it's a shame not more use is made of the custom flags.... Very quick searches.

Lumbra74

Upps, thx for the reminder. I totally forgot to turn off the maintenance mode, while being in a hurry. I'm SORRY!!!

Problem is, if I go to the web address, I can see the content, even if the maintenance mode is on. grmml...

It's now turned off and the site is reachable again.

Lumbra74
stevenaaus wrote:

If you're using less than six sources, instead of having an expensive extra tag, you may want to use the custom flags... Hmm , you probably have more than six sources, but it's a shame not more use is made of the custom flags.... Very quick searches.

I'm using custom flags:

  1. LEDB - LichessEliteDatabase
  2. LGB - LumbrasGigaBase (Games out of a few other sources)
  3. PGNMent - PGN Mentor
  4. TWIC - The Week in Chess
  5. Masters - A database called "Games Of GM's"
  6. LichessB - Games pulled out of the Lichess Broadcast System
stevenaaus

Good work. How did you bulk add a "SOURCE ...." tag ? Unless i'm mistaken, I don't think it's possible to do with Scidvspc.. happy.png?

I'll write that feature today/sometime... it should come in handy.

Lumbra74

For the bulk adding I use the tool pgnextract and a bash script.

continuedkrombopulos22

Is there a way to add all of this information into an AI? Similar to Luk.ai

Lumbra74
continuedkrombopulos22 wrote:

Is there a way to add all of this information into an AI? Similar to Luk.ai

I have no idea. Never experimented with an AI...

And please:

I've created a blog post for future information/discussions:

https://www.chess.com/blog/Lumbra74/lumbras-giga-base-free-massive-game-collection-in-scid-and-pgn-format

stevenaaus

You still have the "Source" tags as well. ??

I stripped them, then compacted the gamefile. Big workout for the gui, laugh, but no problems. Sizes are now:

-rw-r--r-- 1 steve 10285949 Jun 1 13:48 LumbrasGigaBase.sn4
-rw-rw-r-- 1 steve 642779279 Jun 1 13:51 LumbrasGigaBase.si4
-rw-rw-r-- 1 steve 1721331687 Jun 1 13:51 LumbrasGigaBase.sg4

Lumbra74

Yeah, the tag still exist. At first it was just a help to differentiate between my sources. But then, I thought it is a nice feature. 

I don‘t know the sizes of the database files right now, but the version without these tags should be a significant amount smaller.