Data Engineering nydas • 1 month ago • 37%

Hey there Data Engineers. Want to stop putting out fires and start preventing them? Then it might be time to "shift left." By tackling quality, governance, and security from the get-go, you'll save time, money, and headaches. If you want to learn more, follow the paywall bypassed link to my latest article. I hope some of you find this useful!

Data Engineering nydas • 3 months ago • 91%

Time and again I see the same questions asked: "Why should I use dbt?" or "I don't understand what value dbt offers". So I thought I'd put together an article that touches on some of the benefits, as well as putting together a step through on setting up a new project (using DuckDB as the database), complete with associated GitHub repo for you to take a look at. Having used dbt since early 2018, and with my partner being a dbt trainer, I hope that this article is useful for some of you. The link is paywall bypassed.

Data Engineering nydas • 4 months ago • 95%

If you're a Data Engineer, before long you'll be asked to build a real-time pipeline. In my latest article, I build a real-time pipeline using Kafka, Polars and Delta tables to demonstrate how these can work together. Everything is available to try yourself in the associated GitHub repo. So if you're curious, take a moment to check out this technical post.

Data Engineering nydas • 5 months ago • 86%

How often do you build and edit Entity Relationship Diagrams? If the answer is ‘more often than I’d like’, and you’re fed up with tweaking your diagrams, take <5 minutes to read my latest article on building your diagrams with code. Track their changes in GitHub, have them build as part of your CI/CD pipeline, and even drop them into your dbt docs if you like. This is a ‘friends and family’ link, so it’ll bypass the usual Medium paywall. I’m not affiliated to the tool I’ve chosen in any way. Just like how it works. Let me know yours thoughts!

Data Engineering nydas • 7 months ago • 87%

I’ve written a series of Medium articles on creating a Data Pipeline from scratch, using Polars and DeltaTables. The first (linked) is an overview with link to the GitHub repository and each of the deeper dive articles. I then go into the next level of detail, walking through each component. The articles are paywalled (it took time to build and document), but the link provided is the ‘family & friends’ link which bypasses the paywall for the Lemmy community. I hope some of you may find this helpful.

Data Engineering nydas • 8 months ago • 70%

github.com

A few years ago, if you'd mentioned Infrastructure-as-Code (IaC) to me, I would've given you a puzzled look. However I'm now on the bandwagon. And to help others understand how it can benefit them, I've pulled together a simple GitHub repo that showcases how Terraform can be used with Snowflake to manage users, roles, warehouses and databases. The readme hopefully gives anyone who wants to give it a go the ability to step through and see results. I'm sharing this in the hopes that it is useful to some of you.

Data Engineering nydas • 8 months ago • 88%

github.com

Hi all, For those wanting a quick repo to use as a basis to get started, I’ve created jen-ai. There are full instructions in the readme. Once running you can talk to it, and it will respond. It’s basic, but a place to start.

ErgoMechKeyboards nydas • 10 months ago • 100%

The 2x OLED displays are still a work in progress

ErgoMechKeyboards nydas • 10 months ago • 100%

Hi all, I'm hoping for some troubleshooting tips. I have a self-build split keyboard using Blackpills. If I flash either side with 'SPLIT_KEYBOARD = no' in my rules.mk, then both sides work fine (but both working as the left side). If however I set 'SPLIT_KEYBOARD = yes', then both sides stop working. It's driving me insane! These are the relevant details of rules.mk: ``` MCU = STM32F401 BOOTLOADER = stm32-dfu SPLIT_KEYBOARD = yes SERIAL_DRIVER = usart ``` And config.h: ``` #pragma once #define HAL_USE_SERIAL TRUE #define SOFT_SERIAL_PIN A12 #define MASTER_LEFT #define MATRIX_ROWS 6 #define MATRIX_COLS 6 #define SERIAL_USART_DRIVER SD1 #define SERIAL_USART_TX_PAL_MODE 7 ``` And halconf.h: ``` #pragma once #define SERIAL_USB_BUFFERS_SIZE 256 #include_next ``` And mcuconf.h: ``` #pragma once #include_next #undef STM32_SERIAL_USE_USART1 #define STM32_SERIAL_USE_USART1 TRUE ``` Please help! I've been at this for three days.

Mechanical Keyboards nydas • 10 months ago • 100%

Hi all, I'm hoping for some troubleshooting tips. I have a self-build split keyboard using Blackpills. If I flash either side with 'SPLIT_KEYBOARD = no' in my rules.mk, then both sides work fine (but both working as the left side). If however I set 'SPLIT_KEYBOARD = yes', then both sides stop working. It's driving me insane! These are the relevant details of rules.mk: ``` MCU = STM32F401 BOOTLOADER = stm32-dfu SPLIT_KEYBOARD = yes SERIAL_DRIVER = usart ``` And config.h: ``` #pragma once #define HAL_USE_SERIAL TRUE #define SOFT_SERIAL_PIN A12 #define MASTER_LEFT #define MATRIX_ROWS 6 #define MATRIX_COLS 6 #define SERIAL_USART_DRIVER SD1 #define SERIAL_USART_TX_PAL_MODE 7 ``` And halconf.h: ``` #pragma once #define SERIAL_USB_BUFFERS_SIZE 256 #include_next ``` And mcuconf.h: ``` #pragma once #include_next #undef STM32_SERIAL_USE_USART1 #define STM32_SERIAL_USE_USART1 TRUE ``` Please help! I've been at this for two days.

ErgoMechKeyboards nydas • 1 year ago • 100%

I created a 2d surface that I can perform a linear extrusion on, however the result it obviously a hard edge on the extrusion. I would love to be able to add a bezel - either rounded or at 45 degrees. Is there an easy way?

ErgoMechKeyboards nydas • 1 year ago • 100%

I’ve got the basics down, but now looking to do something more complex, and unsure if it’s possible. I have imported a flat shape (a pcb), and I can extrude this out. What I want to do however is to rotate it on its axis, and then extrude it down the z-axis (not directly out from the surface). Is this possible, and if so, how?

ErgoMechKeyboards nydas • 1 year ago • 100%

Is there such a thing as an online pcb tester? As in ‘here is my pcb design, when I connect this, I expect it to register as a circuit on these two pins’

ErgoMechKeyboards nydas • 1 year ago • 100%

Hey there, Hoping someone could point me to a PCB that is using a Blackpill and a ST7789V OLED display. I have the above and am not 100% on which pins to wire up. GND is obvious. VCC I’m pointing to 3.3V, then there is: - CS - DC - Reset - SDA - SCL The smaller screens only have SDA &amp; SCL. Can anyone confirm whether the others are optional, mandatory, whether there are specific/preferred pins? I’m feeling a little lost at the moment, so hoping for some guidance. FYI this is the specific display: [here](https://www.aliexpress.com/item/1005005316683037.html?spm=a2g0o.order_detail.order_detail_item.2.4c7ff19c8MI7a0)

ErgoMechKeyboards nydas • 1 year ago • 100%

Hi all, TL/DR: Ergo Split 36-key with per-key RGB and 2x 2 inch TFT screens, run by 2x BlackPill. Can QMK handle this? I'm hoping someone can sanity check this for me before I go printing a PCB only to find there is no software capable of doing what I want without major code involvement. My plan is for a split ergo keyboard with 36 keys (6 rows of 3 per hand, including the thumb cluster). Each key would have an SK6812-MINI-E RGB backlight, and would be run off a BlackPill controller in both sides. I was going to make the connection using a CAT6 patch cable, understanding I don't need all 8 of the cables, but also that a patch cable clicks into place so a reduced chance of shorting anything by disconnecting the sides while still powered. The gotcha is that I want to run 2x 2" OLED displays, one on each side. Specifically, they are the ST7789V GMT020-02 from Shenzhen GoldenMorning Electronic Co.,Ltd via AliExpress. I know that QMK has Quantum Painter LVGL Integration, and this should support a display. But can I run two independently of one another, one driven off the first BlackPill and the other off the second? Feedback would be greatly appreciated on this! I have all of the hardware, other than the PCB and case. Before I spend too much time designing the PCB, I want to at least hear that it *should* be possible, as opposed to hearing that for a variety of reasons it's an absolute non-starter.

Memmy - An iOS client for Lemmy nydas • 1 year ago • 100%

Where a comment has been made on my post, it would be awesome to see which post it was related to. It helps give context when there are 15 replies to 5 different posts since I last checked.

No Stupid Questions nydas • 1 year ago • 88%

Moore's law is the observation that the number of transistors in an integrated circuit (IC) doubles about every two years. Is there anything similar for the sophistication of AI, or AGI in particular?

ErgoMechKeyboards nydas • 1 year ago • 92%

I’ve never been much of a musical person. But my kid was playing with a toy piano the other day, pressing buttons and whatnot. I lay my fingers on the keyboard and thought “hmmm… kinda like the home row”. So my question to the community: have any of you built musical keyboards? Did you post a blog or guide? At first I was thinking a choc switch with a custom long cap that was held off a pivot point at one end and attached to the switch at the other. But musical keyboards vary sound depending on how you press the note. So maybe Hall effect? Anyway, keen to hear of any adventures down this road by others?

No Stupid Questions nydas • 1 year ago • 96%

When I eat chicken, I call it chicken. Chicken wing; chicken drumsticks etc. When I eat lamb, I call it lamb. Lamb shank; lamb cutlets. So why do I not eat pig or cow? I eat pork or beef. Is there a reason for that?

No Stupid Questions nydas • 1 year ago • 91%

I currently have an iPhone X. I like it, but it’s gradually dying. It’s also a bit too big. Perfect size would be the iPhone 7 or similar. I’ve had different brand phones before this, so while I’ve been on Apple for a while, I’ve had Samsung, Motorola, Sony, Nokia etc. all the way back to the Nokia 3210. I’m becoming a bit fed up of big brands and so want to de-Apple myself, but also not go Google. I would love a dumb phone, but I do have some regular apps: MS Auth for work; Lemmy; Philips Hue; Sensibo; WhatsApp. I was looking at alternative OS options such as Graphene OS, that in theory allow you to run Android apps without Google. But how well do they work? This would be my primary (only) phone. So given size considerations (iPhone 7), ability to not be Apple or Google OS, but also be able to run my key apps, what do my options look like? I’d go into a store and ask, but say ‘not apple and not google’ and you get a vacant stare in response.

ErgoMechKeyboards nydas • 1 year ago • 100%

A couple of keycaps short, but I’ll move them across from my daily driver (at the top) when the time is right. All soldering is done. I just need to program the firmware. But it’s likely not going to happen until the weekend after next due to other commitments. Can’t wait to try it out though! Note: the logo didn’t come out quite right, but I’m not going to bother with a reprint as I still don’t know if I’ll like the layout.

ErgoMechKeyboards nydas • 1 year ago • 100%

Only changes have been to remove the outer most column and so move from 40 keys to 36, plus a change of keycaps and some angled risers for the keycaps on both top and bottom rows.

Mechanical Keyboards nydas • 1 year ago • 97%

It’s going to be a 24 key, choc keyboard with a 2” TFT screen in the centre block. Running off a Blackpill with per-key RGB, and the switches will be sunsets. I’m still very much a novice at Blender, so this is basically just an stl export from OpenSCAD with some colour and lighting. Given that, logos and whatnot aren’t shown. But Gerber files and component stl files are with jlcpbc waiting for printing.

Mechanical Keyboards nydas • 1 year ago • 88%

Hey there, Referring to around 1m40s in the attached Ben Vallack video, he refers to a transparent solder mask to show the traces on the pcb clearly. He’s using pcbway, which seems to be considerably more expensive than jlcpcb who I usually use for my prints. Does anyone know if jlcpcb has this same capability, and if so what the settings are?

Mechanical Keyboards nydas • 1 year ago • 100%

Hi there, Does anyone have suggestions on where I could by legs similar to those found on the ErgoDox that could be attached directly to a pcb (glue or M2 screws)? Looking for a tenting mechanism for a new custom board. Note: I’m aware ErgoDox sells the tenting system independently for US$25, however I would then need a way to attach these to the board. They don’t state what the thread size is, etc.

ErgoMechKeyboards nydas • 1 year ago • 100%

Hi all, I want to create a custom computer keyboard plate that is choc-switch spaced. Are there templates for the slot that a choc switch would clip into (correct width, height & any angles ) that I could incorporate into a keyboard case layout? Plan would likely be to print a blank pcb with the cutouts, so something I could pull into KiCad would be ideal. Note: cross-posted with slight alterations to 3DPrinting.

3DPrinting nydas • 1 year ago • 100%

Hi all, I’ve had a look on thingiverse, but might be using the wrong search term. I want to create a custom computer keyboard plate that is choc-switch spaced. Are there templates for the slot that a choc switch would clip into (correct width, height & depth) that I could incorporate into a keyboard case layout?

Memmy - An iOS client for Lemmy nydas • 1 year ago • 0%

I’ve taken a look through the code, and adding themes seems to be relatively easy. It’s simply the hex values for each color. I would love to add a Gruvbox theme. Should I just create a branch and create a PR, or is there a different process to follow?

ErgoMechKeyboards nydas • 1 year ago • 100%

I’m planning on building a custom keyboard with 24 keys running of a BlackPill. It’ll have OLED and RGB. My question: the BlackPill has 3v and 5v pins. Which should I use for what?

books.goalkicker.com

Thought you might appreciate this.

books.goalkicker.com

Thought I’d share this link. I’m not affiliated in any way.

ErgoMechKeyboards nydas • 1 year ago • 100%

Hi all, I have an idea in my head, but I’m a cable short, and looking for suggestions. 24-key split-ortho (2 keys per finger, where you press both top and bottom keys simultaneously to get the home row key), with per-key RGB and OLED display on the left side. But… I’d like to run this off a single BlackPill controller on the left hand side, and use a CAT6 cable to bridge the two sides. CAT6 has 4 twisted pairs, so 8 cables. If I run a 4x3 matrix then that’s 7 cables. Plus another for the VCC for the RGB. But then no more for the DIN/DOUT for RGB. GND should be fine as I can earth the right hand side separately, but I’m missing a cable if I want RGB. Are there any suggestions on how I might be able to get around my challenge?

Void Linux nydas • 1 year ago • 93%

An older photo from back in the day when I was still on Reddit.

ErgoMechKeyboards nydas • 1 year ago • 100%

I’m looking for a recommendation for choc keycaps based on a 24 key keyboard. Each side will have 2 keys per finger (4 for the index). Pressing the upper and lower key simultaneously will be the equivalent of the home row. My challenge is finding a cap that ‘plays nice’ with pressing two keys next to each other with the same finger. They’re mostly concave to allow you to press into the middle of them. Before I go about designing a set, I wanted to see if anything was already on the market.

Lemmy.World Announcements nydas • 1 year ago • 100%

Just jumped from Reddit and trying to find my way around. Quick question: I signed up at lemmy.world, and I can subscribe to ‘local’ communities, but I’d really like to subscribe to the Linux community on lemmy.ml. Is thot possible? And what are a group of Lemmy users called? Are we Lemmings? Jumped off the end of the Reddit cliff and ended up here?