Personal bits around AI, Programming and other things I might find interesting
Since the publication of the seminal paper Attention is All You Need, the transformer architecture become one of the most important blocks for the design of neural networks architectures. From NLP to Vision, and more recently Audio and Speech, you find them everywhere. But what are Transformers? How do they work? The amount of material … Continue reading Transformers 101
If you ask me what was the best AI/ML result in last year, it was definitely AlphaFold! Forget OpenAI‘s GPT-3. AlphaFold is the real important result. In short, this is what research in AI/ML should aim for: to advance, or even solve, important scientific problems questions. I was very impressed with the results achieved with … Continue reading AlphaFold: the best in 2020
In the last few weeks, a few papers containing evolutionary techniques applied in the context of deep neural networks have been published. For someone with a background on evolutionary computing and interested in everything that is bio-inspired, these are great news! Recently we’ve seen: Evolving Deep Neural Networks , Genetic CNN, Large-Scale Evolution of Image … Continue reading Evolution and Deep Neural Networks
Jorge Tavares Notes 