December 2023

In this edition of our “Haskell in Production” series we interview Jeroen Bransen from Chordify, an online platform, which turns any music or song into chords. Jeroen has been working at Chordify since 2016. Prior to joining it, he obtained his PhD in Software Technology from Utrecht University, where he became acquainted with two of the company’s founders. Initially hired as a Haskell developer, Bransen continues to write Haskell code. Over the years, his responsibilities expanded to include […]

Ver mais

As we step into 2024, the landscape of software development continues to evolve exponentially, driven by technological innovations and changing market needs. For businesses and developers alike, staying abreast of these trends is not just beneficial—it’s essential for remaining competitive and successful. In this article, we explore the key software development trends expected to make a significant impact in 2024. General principles of software engineering in 2024 The general software development approaches set to define the IT industry […]

Ver mais

NLP research has undergone a paradigm shift over the last year. A range of large language models (LLMs) has validated the unreasonable effectiveness of scale. Currently, the state of the art on most benchmarks is held by LLMs that are expensive to fine-tune and prohibitive to pre-train outside of a few industry labs. In the past, a barrier to doing impactful research has often been a lack of awareness of fruitful research areas and compelling hypotheses to explore. […]

Ver mais

Backpropagation is a fundamental component of deep learning for neural networks. Its development has significantly contributed to the widespread adoption of deep learning algorithms since the early 2000s. In this post, we explore the essential concepts associated with this method, as well as its applications and history. What is forward and backward propagation? Forward propagation in neural networks refers to the process of passing input data through the network’s layers to compute and produce an output. Each layer […]

Ver mais

Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct model’s inference speed is about 20 tokens/second on my M2 Macbook with its 24GB of RAM, making it something a lot more practical to play around with than the 10 tokens/hour MOE model. […]

Ver mais

Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k model,developed by Mistral AI, is a Mixture of Experts (MoE) model designed to enhance machine understanding and generation of text. Similar to GPT-4, Mixtral-8x7b uses a Mixture of […]

Ver mais

It is with sadness that I convey the news that Dr. Sean Marrett, a treasured staff scientist for the NIH intramural program’s Functional MRI Facility (FMRIF) for over 20 years, has passed away after a 16 month battle with Mesothelioma. The cruel irony is that it was discovered weeks before his planned retirement. Sean’s “joie de vivre” that he radiated more strongly than anyone I have ever known, has touched so many within the NIH IRP and international […]

Ver mais