Programming

20279 readers

558 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 2 years ago

MODERATORS

snowe@programming.dev

Ategon@programming.dev

MaungaHikoi@lemmy.nz

UlrikHD@programming.dev

How do I keep all the data I need in one single place for my website? (feddit.it)

submitted 17 hours ago by dontblink@feddit.it to c/programming@programming.dev

6 comments fedilink hide all child comments

I need to create a website that holds some events data as well as other content, it will also maybe need to grab some data from APIs.

Since I'm skilled with Hugo (static site generator) I thought I could use that but it's turning out it's a total mess actually.

In Hugo I can have contacts (like events organizers) as taxonomy, but that is a different format (yaml) than CSV or vcard, and it's also static, meaning that if I edit a contact it will only change in Hugo. So I found myself having to manage contacts in 4 different places, in 4 different ways: Hugo yaml, Thunderbird, google contacts, CSV (from earlier days)... And I will add mailchimp once I'll also add a newsletter. This ensures my contacts are kinda becoming a mess.

Same goes with events, it's okay if I generate events in Hugo, but if I grab events from APIs and then the API content changes I will have to modify it on Hugo as well.

Everything it's turning out to be a total mess essentially and I think I tried to use something simple to build something quite complex, I realized the complexity later.

Now ideally I would like to be able to have my contacts, my newsletter, my content in one single place ato have everything nicely synced and not having to deal with 30 different lists or formats.

What should I do?

I know about the jamstack and headless CMS like ghosts and I was wondering if they could be a good solution, or if I should opt for a full CMS. Obvious solution would be WordPress but I wouldn't really want to mess with all the plugins.

Also I spent quite a but of time in building my templates for the Hugo website and throwing everything away would feel awful, if there's a way to reuse them (?).

I know some JavaScript basics but I would avoid it if possible.

you are viewing a single comment's thread
view the rest of the comments

[–] Kissaki@programming.dev 3 points 17 hours ago (1 children)

Have you considered Hugo Data sources (data subfolder)?

Synchronising a data format in there, synchronising the data through APIs and some tooling, and then generate the Hugo website from that data may simplify the process - make it viable despite still having some variance and complexity.

in 4 different ways: Hugo yaml, Thunderbird, google contacts, CSV (from earlier days)

Are you still using CSV? If it's integratable into one of the other three that could reduce complexity by dropping this fourth case?

What do you want your defining state to be? Or should it synchronise across, and changes must be possible in any of the places?

Thunderbird can use Google contacts and calendar. Some tooling could sync to or from or both your Hugo data folder.

[–] dontblink@feddit.it 1 points 16 hours ago

Thank you for your answer!

Yes I've considered using Hugo data sources, but handling all events in one single data file is not really a good way to manage data because Hugo can't programmatically generate content pages from a single data file sadly.. Also again, even if I make a script able to do this, I don't think you can modify content when already created without handling single posts individually.

I could generate a "list of events" but not individual pages from it and not an RSS feed for posts which I would need for newsletters etc..

The thing with CSV is that I kinda lost track of where the actual updated data is, so I'm keeping that updated too, yeah I know I'm a mess.

All the stuff cited is needed for one single job essentially: contacts, newsletter, events.. Which is gathering self published and externally published events and sending them to a list of chosen emails + some integration with social medias.

I'm not a webdev and I thought I could solve this much more easily, but I think doing this correctly would involve using at least an headless CMS + something that is able to grab data from external APIs + some JS framework for building the frontend.

Or relying on a ready full CMS like Ghost or WordPress + theme and hosting on a VPS, which honestly is what I'm leaning towards..

I want to avoid JS if possible as I had terrible coding experiences with it, I know some Rust but webdev in rust is not really a good option from what I've learned.

What do you think?