Thinking Elixir Podcast - Episodes Tagged with “Bumblebee”

197: Thinking Elixir News

ThinkingElixir.com — Tue, 09 Apr 2024 04:15:00 -0600

In this episode, we're diving into the fascinating world of at-home AI with a ready-to-deploy project harnessing Bumblebee and Fly GPUs, unraveling the tale of how an Xz backdoor catastrophe was narrowly sidestepped, and highlighting the power of customizing your Elixir IEx environment. We'll also touch upon the eager anticipation for ElixirConf EU, taking place in Lisbon, where innovations in vehicular tech meet Elixir, and the upcoming NervesConf US - a prime event for embedded systems enthusiasts. Tune in for these buzzworthy topics and more!

Show Notes online - http://podcast.thinkingelixir.com/197

Elixir Community News

https://twitter.com/brainlid/status/1775148526621827548 – Tweet about an easy at-home AI project using Bumblebee and Fly GPUs.
https://fly.io/phoenix-files/easy-at-home-ai-with-bumblebee-and-fly-gpus/ – Blog post detailing the easy deployment of LLM models on Fly.io machines with GPUs.
https://github.com/fly-apps/bumblebee-model-harness – GitHub repository for deploying Llama 2 7B, Mistral 7B, and Zephyr 7B LLMs with Bumblebee.
https://twitter.com/fr0gger_/status/1774342248437813525 – Tweet about the mostly avoided disaster of the Xz backdoor.
https://xkcd.com/2347/ – Related XKCD comic regarding the pressure on open-source developers.
https://en.wikipedia.org/wiki/XZ_Utils_backdoor – Wikipedia article on the XZ Utils backdoor incident.
https://www.wired.com/story/xz-backdoor-everything-you-need-to-know/ – Wired article providing an overview of the Xz backdoor event.
https://diff.hex.pm/ – A resource for Elixir developers to inspect changes between published versions of Hex packages.
https://gist.github.com/brainlid/5cc4944509de87289fb1a1680da22911 – Gist showing an example of an .iex.exs file for customizing IEx behavior.
https://hexdocs.pm/iex/IEx.html#module-the-iex-exs-file – HexDocs documentation on the .iex.exs file.
https://www.elixirconf.eu/ – Website for ElixirConf EU, Europe's largest Elixir Conference.
https://twitter.com/mlainez/status/1773679346328195334 – Tweet teasing a talk about retrofitting a Nissan leaf engine into VWGroup body and using Elixir.
https://twitter.com/NervesConfUS/status/1774473097426370744 – Tweet announcing NervesConf US, a one-day single-track conference.
https://nervesconf.us/ – The official site for NervesConf US with the date and venue information.
https://www.gigcityelixir.com/ – The official site for GigCityElixir with dates and speaker announcements.
https://2024.elixirconf.com/ – The official site for ElixirConf US including dates and location.

Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com

Find us online

Message the show - @ThinkingElixir
Message the show on Fediverse - @ThinkingElixir@genserver.social
Email the show - show@thinkingelixir.com
Mark Ericksen - @brainlid
Mark Ericksen on Fediverse - @brainlid@genserver.social
David Bernheisel - @bernheisel
David Bernheisel on Fediverse - @dbern@genserver.social
Cade Ward - @cadebward
Cade Ward on Fediverse - @cadebward@genserver.social

Sponsored By:

Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

154: Serving Up AI with Sean Moriarity

ThinkingElixir.com — Tue, 06 Jun 2023 04:15:00 -0600

AI topics are all the rage right now, so we team up with Sean Moriarity to unpack what's going on and what it means for Elixir. Sean talks about Nx and his insights on the timing of Elixir's readiness for the public AI shift. He explains some of the Python frustrations that Elixir can alleviate and he shares tips on putting a PoC ML solution into a production Elixir app. Recently, Sean added LLaMa support to Bumblebee and he explains the background for the OpenSource Meta LLM people have been playing with and more! Turns out there's a lot to be excited about for AI and Elixir!

Show Notes online - http://podcast.thinkingelixir.com/154

Elixir Community News

https://github.com/elixir-lang/elixir/releases/tag/v1.15.0-rc.1 – Elixir 1.15.0-rc.1
https://github.com/elixir-lang/elixir/releases/tag/v1.14.5 – Elixir 1.14.5 - small bug fix release
https://elixirforum.com/t/elixirls-not-working-runtime-terminating-during-boot/56017/6 – Elixir-LS crashes with OTP 26. Using OTP 25.x works great.
https://github.com/elixir-lsp/elixir-ls/issues/886 – Issue that tracks Elixir LS OTP 26 issues
https://github.com/phoenixframework/phoenix_live_view/blob/v0.19.0/CHANGELOG.md – Phoenix LiveView 0.19 changelog
https://twitter.com/chris_mccord/status/1663275883845566473 – Chris McCord announced LiveView 0.19 and TodoTrek demo application.
https://phoenixframework.org/blog/phoenix-liveview-0.19-released – Blog post for the LiveView 0.19 release
https://github.com/chrismccord/todo_trek – OpenSourced Todo Trek project. “A trello-like todo board which shows off different dynamic form strategies with Phoenix LiveView.”
https://www.twitch.tv/josevalim – José Valim Twitch account
https://www.twitch.tv/videos/1827518510 – Prompts for AI agents in Elixir - Day 1 (NO LONGER AVAILABLE)
https://www.twitch.tv/videos/1828360654 – Prompts for AI agents in Elixir - Day 2 (NO LONGER AVAILABLE)
https://www.twitch.tv/videos/1832616594 – Contributing to Open Source with Elixir!
https://twitter.com/josevalim/status/1663316201584443394 – José on Twitter sharing the
https://github.com/livebook-dev/livebook/pull/1936 – Livebook doctest feature ended in a PR that was merged.
https://twitter.com/christhekeele/status/1661178730037886978 – Chris Keele shared a tip about customizing your IEx prompt to make copying output easier.
https://www.youtube.com/watch?v=qr6VAfCm_QE – On the shoulder of giants there's room for larger giants- F. Cesarini, A. Leopardi | CBL Mexico 23
https://www.youtube.com/watch?v=7yU9mvwZKoY – Distributed Elixir made easy by Johanna Larsson | Code BEAM Lite Mexico 2023
https://www.youtube.com/watch?v=phRXs8SKzP0 – How to sell Elixir (Again) by Evadne Wu | Code BEAM Lite Stockholm 2023
https://2023.elixirconf.com – ElixirConf tickets are now on sale

Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com

Discussion Resources

https://pragprog.com/titles/smgaelixir/genetic-algorithms-in-elixir/
https://teller.io/
https://github.com/livebook-dev/kino_bumblebee
https://github.com/elixir-nx/bumblebee/pull/199 – You recently added LLaMa support to Bumblebee
https://www.semianalysis.com/p/google-we-have-no-moat-and-neither – Google AI researcher leaked memo
https://ai.facebook.com/blog/large-language-model-llama-meta-ai/
https://en.wikipedia.org/wiki/Monkey_selfie_copyright_dispute – In December 2014, the United States Copyright Office stated that works created by a non-human, such as a photograph taken by a monkey, are not copyrightable.
https://github.com/microsoft/LoRA

Guest Information

https://twitter.com/sean_moriarity – on Twitter
https://github.com/seanmor5/ – on Github
https://seanmoriarity.com – Blog

Find us online

Message the show - @ThinkingElixir
Message the show on Fediverse - @ThinkingElixir@genserver.social
Email the show - show@thinkingelixir.com
Mark Ericksen - @brainlid
Mark Ericksen on Fediverse - @brainlid@genserver.social
David Bernheisel - @bernheisel
David Bernheisel on Fediverse - @dbern@genserver.social
Cade Ward - @cadebward
Cade Ward on Fediverse - @cadebward@genserver.social

Sponsored By:

Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

143: Thinking Elixir News

ThinkingElixir.com — Tue, 21 Mar 2023 04:15:00 -0600

A new minor LiveView release, a new Nerves focused Elixir case study was published, a post about audio transcriptions using Bumblebee and another about using Tailscale to cluster Elixir apps across cloud providers. ElixirConf US was announced, nimble_options reaches 1.0 and more!

Show Notes online - http://podcast.thinkingelixir.com/143

Elixir Community News

https://github.com/phoenixframework/phoenix_live_view/blob/v0.18.17/CHANGELOG.md#01817-2023-03-09 – Phoenix LiveView minor update 0.18.17 released
https://elixir-lang.org/blog/2023/03/09/embedded-and-cloud-elixir-at-sparkmeter/ – New Case Study was added to the ElixirLang website.
https://twitter.com/elixirlang/status/1633795075217006597 – Tweet sharing the SparkMeter case study. Includes brief summary.
https://discord.com/blog/how-discord-stores-trillions-of-messages – Discord, another company using Elixir, wrote a blog post titled “How Discord stores trillions of messages”
https://dockyard.com/blog/2023/03/07/audio-speech-recognition-in-elixir-with-whisper-bumblebee – Blog post from Sean Moriarity on using Elixir with the Whisper ML model and Bumblebee to do audio speech recognition
https://www.richardtaylor.dev/articles/globally-distributed-elixir-over-tailscale – Richard Taylor shared his experiments with clustering Elixir applications across cloud providers.
https://twitter.com/tylerayoung/status/1633477705332031488 – Tyler Young shared a PSA of sorts about using module attributes in Elixir.
https://hexdocs.pm/nimble_publisher/NimblePublisher.html#module-examples – Nimble Publisher example that stresses how to safely use module attributes
https://github.com/dashbitco/nimble_options – Andrea Leopardi released v1.0 of nimble_options.
https://twitter.com/whatyouhide/status/1633844179888640001 – Tweet thread where Andrea talks about the 1.0 considerations.
https://twitter.com/bcardarella/status/1633884901681295367 – Brian Cardarella shared a tweet teasing the ability to have a single Phoenix app serve MacOS, WatchOS and iOS interfaces using LiveView Native.
https://www.meetup.com/dc-elixir/events/292140179/ – Sundi Myint is organizing a meetup to try your conferences talk pitch out and get feedback.
https://2023.elixirconf.com/ – ElixirConf US was announced and will be Sep 5-8 in Orlando, FL at the JW Marriott Orlando Bonnet Creek Resort & Spa
https://twitter.com/ElixirConfAfric/status/1633046390732455936 – ElixirConf Africa - May 26-27 - online only. Call for speakers is open.
https://sessionize.com/elixir-conf-africa-2023 – Submit your talk for ElixirConf Africa

Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com

Find us online

Message the show - @ThinkingElixir
Message the show on Fediverse - @ThinkingElixir@genserver.social
Email the show - show@thinkingelixir.com
Mark Ericksen - @brainlid
Mark Ericksen on Fediverse - @brainlid@genserver.social
David Bernheisel - @bernheisel
David Bernheisel on Fediverse - @dbern@genserver.social
Cade Ward - @cadebward
Cade Ward on Fediverse - @cadebward@genserver.social

Sponsored By:

Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!

130: Bumblebee Buzz with José Valim

ThinkingElixir.com — Tue, 20 Dec 2022 04:15:00 -0700

The Elixir community is buzzing with excitement around Bumblebee! Bumblebee makes it easy to use a variety of pre-trained neural network models in Elixir. José Valim, Paulo Valente, and Jonatan Kłosko join us to talk about this latest advancement. We learn how Bumblebee works, the abilities that are supported today, where things are going next and the longer term visions of what's possible. We cover the new Livebook smart cells that create an easy playground for playing with Bumblebee, a single-file Phoenix example that does image classification, and much more!

Show Notes online - http://podcast.thinkingelixir.com/130

Elixir Community News

https://news.livebook.dev/announcing-bumblebee-gpt2-stable-diffusion-and-more-in-elixir-3Op73O – José Valim made the Bumblebee reveal
https://github.com/elixir-nx/bumblebee/tree/main/examples/phoenix – Phoenix examples using Bumblebee
https://spawnfest.org/2022.html – SpawnFest 2022 winners announced
https://github.com/spawnfest/json_native – 1st place overall - jason_native
https://github.com/spawnfest/secret_vault – Tie for 2nd place - secret_vault
https://github.com/spawnfest/the-arborists – Tied for 2nd place - the-arborists
https://github.com/spawnfest/dtu – 3rd place overall - dtu (“Data The Ultimate”)
https://podcast.thinkingelixir.com/127 – Lively project episode won in Livebook category
https://twitter.com/sorentwo/status/1600167231828086785 – Github's Dependabot Elixir support explained
https://fosstodon.org/@tylerayoung/109467615067473743 – Post from Tyler Young about Dependabot
https://twitter.com/ElixirMembrane/status/1599751442180382721 – The Membrane GitHub org is changing to Jellyfish
https://podcast.thinkingelixir.com/43 – Previous interview about Membrane
https://github.com/benvp/ex_cva – Class Variance Authority library
https://elixirforum.com/t/cva-easily-construct-component-variants/52043 – CVA variant usage explained
https://github.com/joe-bell/cva – Original implementation in JS

Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at show@thinkingelixir.com

Discussion Resources

https://twitter.com/josevalim/status/1600955042621976576 – Bumblebee announcement
https://news.livebook.dev/announcing-bumblebee-gpt2-stable-diffusion-and-more-in-elixir-3Op73O – Livebook announcement with embedded Youtube video
https://www.youtube.com/watch?v=g3oyh3g1AtQ – YouTube show-and-tell video from Jose
https://twitter.com/josevalim/status/1601228739819450368 – Guest article on HuggingFace about Elixir and ML
https://huggingface.co/blog/elixir-bumblebee
https://github.com/elixir-nx/bumblebee/tree/main/examples/phoenix – Examples of embedding a Phoenix app in a single file from Chris McCord
https://github.com/livebook-dev/kino_bumblebee – Livebook smart cell
https://podcast.thinkingelixir.com/109 – Paulo episode
https://podcast.thinkingelixir.com/46 – Jonatan episode
https://huggingface.co
https://github.com/elixir-nx/scholar
https://podcast.thinkingelixir.com/104 – Exploring Our Data with Chris Grainger
https://podcast.thinkingelixir.com/95 – Rustler Precompiled with Philip Sampaio
https://en.wikipedia.org/wiki/Federated_learning
https://prise.com/
https://www.amplified.ai/
https://github.com/polvalente/nx-signal
https://erlef.org/slack-invite/erlef

Guest Information

https://genserver.social/josevalim – José Valim on Mastadon
https://twitter.com/josevalim – José Valim on Twitter
https://github.com/josevalim – José Valim on Github
https://dashbit.co/ – Dashbit website and blog
https://github.com/jonatanklosko/ – Jonatan Kłosko on Github
https://jonatanklosko.com/ – Blog
jonatanklosko@gmail.com – Jonatan's email
https://twitter.com/polvalente – Paulo Valente on Twitter
https://github.com/polvalente/ – Paulo Valente on Github

Find us online

Message the show - @ThinkingElixir
Message the show on Mastadon - @ThinkingElixir@genserver.social
Email the show - show@thinkingelixir.com
Mark Ericksen - @brainlid
Mark Ericksen on Mastadon - @brainlid@genserver.social
David Bernheisel - @bernheisel
David Bernheisel on Mastadon - @dbern@genserver.social
Cade Ward - @cadebward
Cade Ward on Mastadon - @cadebward@genserver.social

Sponsored By:

Fly.io: Fly.io is a great place to deploy your next Phoenix application! Check them out!