toad.social

Gordon InggsCome work with us at the City of <a href="https://fosstodon.org/tags/CapeTown" class="mention hashtag" rel="nofollow noopener" target="_blank">#CapeTown</a> - <a href="https://uct.ac.za/sites/default/files/2025-08/com-e25810-datascientist-jpal-saldru-soe.pdf" rel="nofollow noopener" translate="no" target="_blank">https://uct.ac.za/sites/default/files/2025-08/com-e25810-datascientist-jpal-saldru-soe.pdf</a>The job says data scientist, but really this is a <a href="https://fosstodon.org/tags/CivicTech" class="mention hashtag" rel="nofollow noopener" target="_blank">#CivicTech</a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> position. We run a decent Open Source, modern data stack, but what sets us apart is our great culture - family first, psychologically safe, curiosity encouraged and reward!Would appreciate any boosts for reach!

kamatahvelHi <a href="https://infosec.exchange/tags/GetFediHired" class="mention hashtag" rel="nofollow noopener" target="_blank">#GetFediHired</a>, I'm looking for a <a href="https://infosec.exchange/tags/remote" class="mention hashtag" rel="nofollow noopener" target="_blank">#remote</a> role in the US (or <a href="https://infosec.exchange/tags/sweden" class="mention hashtag" rel="nofollow noopener" target="_blank">#sweden</a> if you provide visa assistance!). I've worked mostly in <a href="https://infosec.exchange/tags/SoftwareEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareEngineering</a> space, but I do lean closer to the <a href="https://infosec.exchange/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> side of things (past 3 years). Before that I was varying levels of doing SWE things inside a <a href="https://infosec.exchange/tags/BusinessIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#BusinessIntelligence</a> role (~5 years).Looking for something that demands strong <a href="https://infosec.exchange/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#Python</a> skills (~5+ years of heavy, daily use), though wouldn't mind having to learn something new. Quite comfortable in a few <a href="https://infosec.exchange/tags/SQL" class="mention hashtag" rel="nofollow noopener" target="_blank">#SQL</a> flavors. I can actually read most <a href="https://infosec.exchange/tags/regex" class="mention hashtag" rel="nofollow noopener" target="_blank">#regex</a>, if that's a thing worth bragging about. Love writing <a href="https://infosec.exchange/tags/xpath" class="mention hashtag" rel="nofollow noopener" target="_blank">#xpath</a> in personal webscraping projects. Somewhat familiar with <a href="https://infosec.exchange/tags/SpringBoot" class="mention hashtag" rel="nofollow noopener" target="_blank">#SpringBoot</a> and <a href="https://infosec.exchange/tags/Kotlin" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kotlin</a> (1 year, occasional) and would like to eventually use more Java in work, but not a hard requirement. I love refactoring/improving old code, and I have lots of experience with CI/CD, coding best practices, testing, web scraping, backend (Flask) & frontend (React, Typescript). Send me a message if this sounds like I'd be a great fit on your team!

PositWhat makes tools truly useful? Episode 2 of <a href="https://fosstodon.org/tags/TheTestSet" class="mention hashtag" rel="nofollow noopener" target="_blank">#TheTestSet</a> features Wes McKinney (Part 1of 2!) sharing his experience building Pandas & Arrow, plus his surprising past in speedrun communities.Tune in for his story at thetestset.co, on Spotify, or Apple Podcasts<a href="https://fosstodon.org/tags/DataStack" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataStack</a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://fosstodon.org/tags/Podcast" class="mention hashtag" rel="nofollow noopener" target="_blank">#Podcast</a> <a href="https://fosstodon.org/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#Python</a>

PositEver wonder about the mind behind Pandas & Apache Arrow? 🤔 Ep. 2 of <a href="https://fosstodon.org/tags/TheTestSet" class="mention hashtag" rel="nofollow noopener" target="_blank">#TheTestSet</a> (Part 1!) unpacks Wes McKinney's journey – including his speedrunning past! What makes good tools good?🎧 Listen at <a href="https://thetestset.co" rel="nofollow noopener" translate="no" target="_blank">https://thetestset.co</a>, on Spotify, or Apple Podcasts<a href="https://fosstodon.org/tags/DataStack" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataStack</a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://fosstodon.org/tags/Pandas" class="mention hashtag" rel="nofollow noopener" target="_blank">#Pandas</a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://fosstodon.org/tags/PodcastLaunch" class="mention hashtag" rel="nofollow noopener" target="_blank">#PodcastLaunch</a> <a href="https://fosstodon.org/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#Python</a>

Will Hopkins 🌈📸<a href="https://a2mi.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a> If you needed to use a data lake with Redshift, would you use Iceberg, given some native support, over Delta Lake, which is arguably a better format?Asking for a friend who is me

blaze.email🔍 Excited about AXLearn for modular ML training, Pinterest's Moka for massive data processing, and PromiseTune for causal configuration tuning! <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://blaze.email/Machine-Learning-Engineer" rel="nofollow noopener" translate="no" target="_blank">https://blaze.email/Machine-Learning-Engineer</a>

Rami Krispin :unverified:My weekly newsletter is out! 🚀This week's agenda: 🔹 Open Source of the Week - The dagster project 🔹 New learning resources - Forecasting with linear regression, multi-model LLM, multiprocessing with Python 🔹 Book of the week - Visualization for Social Data Science by Roger Beecham📌 Join 29k subscribers and subscribe to get weekly updates 🗞️👇🏼 <a href="https://ramikrispin.substack.com/p/the-dagster-project-visualization" rel="nofollow noopener" translate="no" target="_blank">https://ramikrispin.substack.com/p/the-dagster-project-visualization</a><a href="https://mstdn.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataScience</a> <a href="https://mstdn.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mstdn.social/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#Python</a> <a href="https://mstdn.social/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#RStats</a> <a href="https://mstdn.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://mstdn.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a>

⚯ Michel de Cryptadamus ⚯pro tip for user interface designers:if you have hundreds of millions of dollars of venture capital and you want to make a user facing data analytics tool of some kind and you think it's reasonable to ask an average human being to type this: CAST('2023-05-01' AS TIMESTAMP)to do literally anything with a date or time in your application's user interface, just stop right there. do not pass go, do not collect $200, and do not ever attempt to offer feedback to a UX designer ever again. something is deeply broken inside you that means there are certain mysteries of the universe that even the guys who designed the postgres command line can access that you will never know, and that's ok. You can still live a really rad life.<a href="https://universeodon.com/tags/SQL" class="mention hashtag" rel="nofollow noopener" target="_blank">#SQL</a> <a href="https://universeodon.com/tags/dba" class="mention hashtag" rel="nofollow noopener" target="_blank">#dba</a> <a href="https://universeodon.com/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a> <a href="https://universeodon.com/tags/postgres" class="mention hashtag" rel="nofollow noopener" target="_blank">#postgres</a>

⚯ Michel de Cryptadamus ⚯scariest shit i've seen in years

GrowthBookThe problem: Setting up GA + BigQuery = 40+ manual steps, delayed insights, expensive queriesOur solution: Managed Warehouse with:One-click deployment Real-time ClickHouse backend Usage-based pricing Built-in feature flag analyticsFirst 2M events/month free for Pro users. Raw SQL access maintained for power users. Self-hosters: We're working on bringing Feature Usage Analytics to on-prem deployments too 👀 <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/ClickHouse" class="mention hashtag" rel="nofollow noopener" target="_blank">#ClickHouse</a>

OS-SCIRust is transforming data engineering by offering unparalleled performance and cost efficiency. Singular's Extract platform, powered by Rust, achieves 17x performance improvements and up to 70% cost reductions. With memory safety and modern design, Rust is becoming the go-to for data-intensive workloads. Learn how Rust is outperforming Python and Java in enterprise data pipelines. <a href="https://mastodon.social/tags/RustLang" class="mention hashtag" rel="nofollow noopener" target="_blank">#RustLang</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/TechAdvancements" class="mention hashtag" rel="nofollow noopener" target="_blank">#TechAdvancements</a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Programming</a>"<a href="https://thenewstack.io/rust-eats-pythons-javas-lunch-in-data-engineering/" rel="nofollow noopener" translate="no" target="_blank">https://thenewstack.io/rust-eats-pythons-javas-lunch-in-data-engineering/</a>

pipTrendsPinpointing differences between two tables is very important for tasks like validating data migrations or spotting corruption. But when those tables live in different databases, it becomes tricky due to issues like network costs and different SQL dialects. In this article, Erez Shinnan shared how Reladiff tackles these challenges and its development journey.<a href="https://eshsoft.com/blog/how-reladiff-works" rel="nofollow noopener" translate="no" target="_blank">https://eshsoft.com/blog/how-reladiff-works</a><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Programming</a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#PythonProgramming</a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareDevelopment</a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a>

Lenin alevski 🕵️💻New Open-Source Tool Spotlight 🚨🚨🚨Transform any URL into an LLM-ready input with `Reader`. Just prefix the URL with `<a href="https://r.jina.ai/`" rel="nofollow noopener" translate="no" target="_blank">https://r.jina.ai/`</a> for clean, readable content extraction. Perfect for enhancing agents & RAG pipelines. <a href="https://infosec.exchange/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LLM</a> <a href="https://infosec.exchange/tags/NLP" class="mention hashtag" rel="nofollow noopener" target="_blank">#NLP</a>Need web search results for your LLM? Prepend queries with `<a href="https://s.jina.ai/`" rel="nofollow noopener" translate="no" target="_blank">https://s.jina.ai/`</a> to fetch top results—content included. E.g., `<a href="https://s.jina.ai/your+query`" rel="nofollow noopener" translate="no" target="_blank">https://s.jina.ai/your+query`</a> brings knowledge directly to your model. <a href="https://infosec.exchange/tags/AItools" class="mention hashtag" rel="nofollow noopener" target="_blank">#AItools</a> <a href="https://infosec.exchange/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> Reader API now supports images! Captions are auto-generated for images missing alt tags, giving LLMs better context for reasoning and summarizing multimedia pages. <a href="https://infosec.exchange/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://infosec.exchange/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>🔗 Project link on <a href="https://infosec.exchange/tags/GitHub" class="mention hashtag" rel="nofollow noopener" target="_blank">#GitHub</a> 👉 <a href="https://github.com/jina-ai/reader" rel="nofollow noopener" translate="no" target="_blank">https://github.com/jina-ai/reader</a><a href="https://infosec.exchange/tags/Infosec" class="mention hashtag" rel="nofollow noopener" target="_blank">#Infosec</a> <a href="https://infosec.exchange/tags/Cybersecurity" class="mention hashtag" rel="nofollow noopener" target="_blank">#Cybersecurity</a> <a href="https://infosec.exchange/tags/Software" class="mention hashtag" rel="nofollow noopener" target="_blank">#Software</a> <a href="https://infosec.exchange/tags/Technology" class="mention hashtag" rel="nofollow noopener" target="_blank">#Technology</a> <a href="https://infosec.exchange/tags/News" class="mention hashtag" rel="nofollow noopener" target="_blank">#News</a> <a href="https://infosec.exchange/tags/CTF" class="mention hashtag" rel="nofollow noopener" target="_blank">#CTF</a> <a href="https://infosec.exchange/tags/Cybersecuritycareer" class="mention hashtag" rel="nofollow noopener" target="_blank">#Cybersecuritycareer</a> <a href="https://infosec.exchange/tags/hacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#hacking</a> <a href="https://infosec.exchange/tags/redteam" class="mention hashtag" rel="nofollow noopener" target="_blank">#redteam</a> <a href="https://infosec.exchange/tags/blueteam" class="mention hashtag" rel="nofollow noopener" target="_blank">#blueteam</a> <a href="https://infosec.exchange/tags/purpleteam" class="mention hashtag" rel="nofollow noopener" target="_blank">#purpleteam</a> <a href="https://infosec.exchange/tags/tips" class="mention hashtag" rel="nofollow noopener" target="_blank">#tips</a> <a href="https://infosec.exchange/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a> <a href="https://infosec.exchange/tags/cloudsecurity" class="mention hashtag" rel="nofollow noopener" target="_blank">#cloudsecurity</a>— ✨ 🔐 P.S. Found this helpful? Tap Follow for more cybersecurity tips and insights! I share weekly content for professionals and people who want to get into cyber. Happy hacking 💻🏴‍☠️

pipTrendsWhile indexes are useful, relying on them too much can be like Maslow's hammer. <a href="https://mastodon.social/@treyhunner" class="u-url mention" rel="nofollow noopener" target="_blank">@treyhunner</a> has shown some fantastic alternative methods for common tasks without constantly needing to use indexes.<a href="https://www.pythonmorsels.com/avoid-indexes-in-python/" rel="nofollow noopener" translate="no" target="_blank">https://www.pythonmorsels.com/avoid-indexes-in-python/</a><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Programming</a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#PythonProgramming</a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#ml</a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareDevelopment</a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebDevelopment</a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#TechNews</a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a>

pipTrendsThe <a href="https://mas.to/@huggingface" class="u-url mention" rel="nofollow noopener" target="_blank">@huggingface</a> team has created tiny-agents, a new feature that lets their huggingface_hub software act as a Model Context Protocol (MCP) Client. In their recent article, they explained how to set up these tiny agents to give new abilities to your LLMs to interact with the world and perform complex tasks.<a href="https://huggingface.co/blog/python-tiny-agents" rel="nofollow noopener" translate="no" target="_blank">https://huggingface.co/blog/python-tiny-agents</a><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Programming</a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#PythonProgramming</a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#ml</a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareDevelopment</a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebDevelopment</a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#TechNews</a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a>

dealingwithIf anyone knows Data Engineers looking for work, this is our next hire: <a href="https://www.linkedin.com/posts/dealingwith_dataengineering-hiring-startuplife-activity-7338312558455476224-jvGh" rel="nofollow noopener" translate="no" target="_blank">https://www.linkedin.com/posts/dealingwith_dataengineering-hiring-startuplife-activity-7338312558455476224-jvGh</a><a href="https://billee.applytojob.com/apply/iTXqZOqOUu/Senior-Data-Engineer" rel="nofollow noopener" translate="no" target="_blank">https://billee.applytojob.com/apply/iTXqZOqOUu/Senior-Data-Engineer</a><a href="https://indieweb.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://indieweb.social/tags/hiring" class="mention hashtag" rel="nofollow noopener" target="_blank">#hiring</a> <a href="https://indieweb.social/tags/getfedihired" class="mention hashtag" rel="nofollow noopener" target="_blank">#getfedihired</a> <a href="https://indieweb.social/tags/FediHire" class="mention hashtag" rel="nofollow noopener" target="_blank">#FediHire</a>

pipTrendsLast month, two new Rust-based Python type checkers, pyrefly and ty were released. Both of them are in the alpha stage. While they share some similarities, they differ significantly in design and features. In this article, Edward Li dove deep into both tools, highlighted their differences and what makes each one unique.<a href="https://blog.edward-li.com/tech/comparing-pyrefly-vs-ty/" rel="nofollow noopener" translate="no" target="_blank">https://blog.edward-li.com/tech/comparing-pyrefly-vs-ty/</a><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Programming</a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#PythonProgramming</a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#ml</a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareDevelopment</a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebDevelopment</a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#TechNews</a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a>

Mike SpencerA great job with a fantastic group: <a href="https://www.dataorchard.org.uk/analytics-engineer-vacancy" rel="nofollow noopener" translate="no" target="_blank">https://www.dataorchard.org.uk/analytics-engineer-vacancy</a><a href="https://mastodon.scot/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataScience</a> <a href="https://mastodon.scot/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.scot/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#RStats</a> <a href="https://mastodon.scot/tags/JobFairy" class="mention hashtag" rel="nofollow noopener" target="_blank">#JobFairy</a> <a href="https://mastodon.scot/tags/FediHire" class="mention hashtag" rel="nofollow noopener" target="_blank">#FediHire</a> <a href="https://data-folks.masto.host/@data_orchard" class="u-url mention" rel="nofollow noopener" target="_blank">@data_orchard</a>

Seán Fobbe🔔 New Slides 🔔 I've made the slides for my recent talk on "Legal Data Engineering" available <a href="https://fediscience.org/tags/OpenAccess" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenAccess</a> Slides: <a href="https://zenodo.org/records/15575231" rel="nofollow noopener" translate="no" target="_blank">https://zenodo.org/records/15575231</a> (in German) <a href="https://fediscience.org/tags/OpenAccess" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenAccess</a> <a href="https://fediscience.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://fediscience.org/tags/Law" class="mention hashtag" rel="nofollow noopener" target="_blank">#Law</a>

Seán Fobbe🔔 Slides zu Legal Data Engineering 🔔 Was ist Legal Data Engineering? Wie sieht die Praxis juristischer Daten in Deutschland aus? Welche rechtlichen Probleme ergeben sich im Zusammenhang mit Legal Data Engineering? Diese Präsentation bietet eine Einführung zu Legal Data Engineering und sucht Antworten auf diese Fragen.Slides: <a href="https://zenodo.org/records/15575231/files/Fobbe_2025-05-28_Legal-Data-Engineering.pdf?download=1" rel="nofollow noopener" translate="no" target="_blank">https://zenodo.org/records/15575231/files/Fobbe_2025-05-28_Legal-Data-Engineering.pdf?download=1</a>Legal Data Engineering ist der Schwerpunkt eines jeden Legal Data Science Projekts. Kern von Data Engineering ist der ETL-Prozess: Extraktion, Transformation und das (Hoch-)Laden von Daten. Die Slides bieten dazu einen allgemeinverständlichen Überblick.Weitere praktische Themen sind die Verfügbarkeit juristischer Daten in Deutschland (insbesondere strukturierter Daten und Programmierschnittstellen), Probleme bei der Tokenisierung in Large Language Models und die Fehlerkennung von Gen-Namen in Microsoft Excel.Bei den rechtlichen Fragen des Legal Data Engineering behandle ich die tradierte Rechtslage, das neue Datennutzungsgesetz (DNG) und Bayern als Negativbeispiel einer verschlossenen juristischen Datenkultur. Eine Diskussion der Datenschutzklage gegen OpenJur und der Open Data-Klage der Gesellschaft für Freiheitsrechte (GFF) gegen die Bundespolizei klären über aktuelle Entwicklungen in diesem Rechtsbereich auf.<a href="https://fediscience.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://fediscience.org/tags/OpenAccess" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenAccess</a> <a href="https://fediscience.org/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenScience</a> <a href="https://fediscience.org/tags/Law" class="mention hashtag" rel="nofollow noopener" target="_blank">#Law</a> <a href="https://fediscience.org/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a> <a href="https://fediscience.org/tags/Datennutzungsgesetz" class="mention hashtag" rel="nofollow noopener" target="_blank">#Datennutzungsgesetz</a> <a href="https://fediscience.org/tags/Pipeline" class="mention hashtag" rel="nofollow noopener" target="_blank">#Pipeline</a> <a href="https://fediscience.org/tags/Data" class="mention hashtag" rel="nofollow noopener" target="_blank">#Data</a>

Recent searches

Search options

Administered by:

Server stats:

#dataengineering