Concordancing the DGT with lightning speed
Initiator des Themas: 2nl (X)
2nl (X)
2nl (X)  Identity Verified
Niederlande
Local time: 02:47
Oct 2, 2014

Source: http://cafetran.wikidot.com/changelog

2014-09-29 Significant performance improvements in the H2 SQL database. New indexing system; existing tables won’t work. You need to delete the existing tables. Next, create a new table and import your data again. On an i3 laptop it takes 2-3 seconds to complete a search in 1.5 million TUs.

Within seconds, your gigantic
... See more
Source: http://cafetran.wikidot.com/changelog

2014-09-29 Significant performance improvements in the H2 SQL database. New indexing system; existing tables won’t work. You need to delete the existing tables. Next, create a new table and import your data again. On an i3 laptop it takes 2-3 seconds to complete a search in 1.5 million TUs.

Within seconds, your gigantic database is queried and all matches are displayed:

https://www.youtube.com/watch?v=uhBS5MLNIBg

The database used in the demonstration movie contains 2 million TUs from the DGT. Note that 'Verordnung' and 'Kommission' are very frequent in the DGT, so collecting all hits takes more time.

More info: http://cafetran.wikidot.com/working-with-external-databases
Collapse


 
FarkasAndras
FarkasAndras  Identity Verified
Local time: 02:47
Englisch > Ungarisch
+ ...
I wonder... Oct 3, 2014

... how this compares to TMLookup (which uses sqlite without any added special sauce).
It does look very fast on the youtube video. Care to do a comparison test?


 
2nl (X)
2nl (X)  Identity Verified
Niederlande
Local time: 02:47
THEMENSTARTER
Michael's at it Oct 3, 2014

Michael Beijer is doing some tests with his huge resources (45 GB). I'm quite sure he will report as soon as he's ready.

 
Meta Arkadia
Meta Arkadia
Local time: 07:47
Englisch > Bahasa Indonesia
+ ...
MySQL Oct 3, 2014

FarkasAndras wrote:
...which uses sqlite without any added special sauce

Igor is going to add MySQL soon, and I suppose SQLite will be next. That would be a nice test, CT SQLite against TMLookup SQLite.

Cheers,

Hans


 


To report site rules violations or get help, contact a site moderator:

Moderatoren dieses Forums
Natalie[Call to this topic]

You can also contact site staff by submitting a support request »

Concordancing the DGT with lightning speed






Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »
Wordfast Pro
Translation Memory Software for Any Platform

Exclusive discount for ProZ.com users! Save over 13% when purchasing Wordfast Pro through ProZ.com. Wordfast is the world's #1 provider of platform-independent Translation Memory software. Consistently ranked the most user-friendly and highest value

Buy now! »