Engineering challenges for a real RAG application
A case study with R-help-chat
Blog
Combating concept drift in LLM applications
Your LLM application works beautifully at launch. The model understands user preferences, accuracy metrics look great, and feedback is positive. Then, gradua...
Deploying AI4citations: From research to production
Building a production-ready citation verification system with automated testing, comprehensive APIs, and scalable deployment
Modern understanding of overfitting and generalization in machine learning
In a previous post, I described my experience with fine-tuning transformer models on small NLP datasets with less than a few thousand examples. One of the go...
Experimenting with transformer models for citation verification
Automated verification of scientific claims represents a critical application of natural language processing in maintaining research integrity. The exponenti...
ML MiniLesson: Using pretrained layers
Transfer learning take layers of an existing neural network previously trained on a (usually large) dataset. These layers are the starting point to build a n...
LLMs in claim verification
Scientific papers make lots of claims with supporting citations. However, even well-intentioned writers make mistakes, and automated citation verification is...
Thermodynamic data consistency: The case of Li-mica
How do ore deposits form? This question motivates geochemists to build internally consistent thermodynamic databases to predict conditions where minerals pre...
Hypothesis-driven feature engineering
I’m starting a machine learning project to use microbial communities as biosensors for redox potential. Why is this important? Well, redox potential (written...
Sustainable data preprocessing with pipelines
Early in my modeling of the Titanic dataset (a kind of “Hello World” for machine learning), I was struck by the variety - or inconsistency - of data preproce...
Installing AutoSklearn with conda
I really wanted to try out the examples of using AutoSklearn over at Machine Learning Mastery. But when I ran pip install auto-sklearn, an error occurred: