👋 Hey there friend!!! My name is David Dansby. Sometimes I go by DataDavd or datadavd online (a relic from data engineering days). I am a self-taught software engineer at Atlassian. I have a strong passion for secure data processing systems, Go, Python, and rare single-origin coffees. When time allows you can find me tinkering with one of my split mechanical keyboards. Given I just bought a house, I’ve recently been getting into home automation.
💪 I’m currently working remotely at Atlassian as a Software Engineer on our Jira Align product (mostly working on the C#/.NET backend sprinkled with some frontend work in React). Previously, I worked on the Bitbucket Cloud Data Privacy and Security team as a software engineer using Go and Python with a focus on all things security and data protection. And before that, I was a data engineer on the Data Analytics and Engineering team at Atlassian that owned the core data pipelines (we typically ingested 500GB+ of data each day into our pipelines; and processed even more!!!).
💻 Outside of work I'm constantly learning and improving my skills. Currently, I've been heavily using AI tools like ChatGPT, Copilot, Bard, HuggingChat, and Claude 2.0 to enhance both my software engineering skillset, work efficiency, and overall life productivity.
📚 Outside of software engineering and tech, I'v been diligently learning French to deepen my understanding of her culture, and enhance my communication with my wife's family and friends. And, since I've moved to Seattle last year, I've been snowboarding and hiking with my brother now that I'm closer to him. Lastly, I love using travel points to fly business/first class around the world with my better half, my amazing wife.
- v0.2.0: Add the ability for users to set what hash algorithms they want to use for digest calculation. Pull Request #292
- v0.5.2: Trivial nit change to add shothand vars to two common witness run options. Pull Request #441
- v0.48.0: Fixed bug to correctly return error when users navigate to routes downstream from
BaseURL. Pull Request #2382. - v0.54.0: Added in-app lakeFS documentation links on the Setup, Create a Repository (Modal), Branches, and Auth/Admin pages of lakeFS UI. Pull Request #2506.
- v0.62.0: Remove unused functions in tx.go. Pull Request #3128.
- v0.63.0: Fix 'Create a Repo' minimum character limit wording. Pull Request #3155.
- v0.9.21: Added Diff-Stat functionality. Pull Request #145.
- v0.9.24: Created RepositoryRefsOptions type and ListRefs method. Pull Request #155.
- v0.9.30: Update GetDiffStat functionality to filter response fields. Pull Request #171.
- Pull Request #156: This PR simplifies TagOptions and BranchOptions types into a single RefOptions type (since git tags and branches are both refs) and adds DeleteBranch and DeleteTag functionality.
- v0.23.2: Update GCP icons using the official, updated GCP icons. (see Issue #554).
I sign all my commits (with vigilant mode) to ensure its really me contributing.
- Go
- Python
- Javascript
- Backend software engineering
- Web Development and REST APIs (Django, React, Go's net/http, etc.)
- concurrent programming (goroutines, channel, select, asyncio, concurrent.futures, etc.)
- React
- batch and stream data processing (Apache Spark and Presto)
- OOP
- TTD
- Docker and Docker Compose
- Bitbucket Pipelines
- GitHub Actions
- Splunk
- SignalFX
- Sentry
- Opsgenie
- Statuspage
- statsd
- SonarQube
- AWS: SQS, Lambda, S3, EMR, EC2, SNS, aws-sdk-go, boto3, etc.
- LocalStack
- SparkSQL
- HiveSQL
- Presto
- PostgreSQL
- writing complex SQL queries, mostly SparkSQL
- building and maintaining big data pipelines AND platforms
- swimming in data lakes
- organizing data warehouses
- distributed data processing
- backend data services and APIs
- lakeFS
- Databricks
- Apache Spark
- Apache Airflow
- PyData packages
- Apache Flink (wish to use more)
- Apache Pulsar (wish to use much more; Pulsar > Kafka)
- Jira Software
- Confluence
- Jira Service Management
- Trello
- Halp
- Slack
