Performance Benchmarking and Cost Analysis of Machine Learning Techniques: An Investigation into Traditional and State-Of-The-Art Models in Business Operations

This spring, Valu8 data scientist Kajsa Norin supervised a stellar thesis project undertaken by two brilliant KTH students, Sam Taheri and Jacob Lundgren. Partnering with Valu8 Company Intelligence, they dived deep into various NLP methods for company classification – comparing traditional approaches such as stemming, lemmatisation and tfidf with models like SVM and logistic regression, to the more modern transformer models, using both pre-trained contextual embeddings and fine-tuning a BERT classifier.

While they suspected that a fine-tuned model would perform the best, it’s interesting to see the precision versus cost graph and how it tapers off. Not included in the graph is the use of large foundation models such as GPT-4 – some preliminary tests would put the precision slightly higher but the cost would 1000-fold with the current API prices.

It shows that bigger is not always better and choosing a model is always about weighing the trade-offs, especially when cost is a factor.

Thanks again for a brilliant thesis, Sam and Jacob!

Link for anyone who’s interested:

#nlp #ai #valu8

Polaris Flexible Capital is delighted to announce a strategic investment in InArea Group AB

Polaris Management A, the Denmark based private equity firm, has invested an undisclosed amount in InArea Group AB, the Sweden …

Read More →

trawa raises EUR 10m

Future Energy Services (ta trawa), the Germany based cleantech startup, has raised EUR 10m in a seed funding round led …

Read More →

Vaaka Partners has successfully completed the sale of Tietokeskus

Vaaka Partners Buyout Fund II Ky, a fund managed by Vaaka Partners Oy, the Finland based private equity firm, has …

Read More →

Omni Partners makes majority investment in Compass Continuing Healthcare

Omni Partners, the UK based venture capital firm, has acquired a majority stake in Compass Continuing Healthcare (a.k.a Compass CHC), …

Read More →

Newlight Partners sell Lit Fibre to CityFibre

CityFibre Holdings Ltd, the UK based independent fibre broadband infrastructure provider, has acquired a 100% stake in Lit Fibre Group …

Read More →

Procuritas Capital Investors VII acquires a majority share of Energima Gruppen AS

Procuritas Partners AB, the Sweden based private equity firm, has acquired a majority stake in Energima Gruppen AS, the Norway …

Read More →