Show HN: Delve, an open source (AGPL) enterprise-grade data analytics platform
github.comHello, I am excited to announce the release of my project that I've been working on for quite a while. It has gone through many iterations. I believe that I now have a scalable platform that can efficiently ingest, search and report on large quantities of data.
If you are at a very large scale, there will need to be some work to streamline your database access, but it is very possible to build a flexible and robust solution.
Delve is built using Django, Django Rest Framework, webpack, JS and SCSS.
Delve can be extended with apps, which are actually specially built Django apps.
Delve has a unix-pipe-like search language that is powered by simple python scripts.
The Delve Web UI has support for showing data in tables, line charts and bar charts with more visualizations on the way.
I am excited to hear your feedback and suggestions.
I will be trying to monitor the comments and reply quickly.
Delve is the name of a popular debugger: https://github.com/go-delve/delve
Thank you. I appreciate you pointing this out.
It seems like Delve is a popular name for software, which makes sense.
I am officially looking for a new name for this software.
It used to be called Flashlight, as in "A portable tool to shine some light on your data", but I liked the name Delve and a naive google search didn't reveal any projects named delve.
As an aside, Delve is not only popular in software naming, but it also appears in the English language writing quite a lot.
DelveDeep, DeepDelve, DataDelve, DelveData, DelveLight, FlashDelve, DelveFlash
Wish I could help, but names are hard.
They really are.
Up until fairly recently, Delve was a Microsoft product that profiled and analyzed corporate data... you might run into some confusion.
https://supersimple365.com/microsoft-is-killing-delve-here-a...
Thank you for letting me know. I did not know about the Delve MS product.
I just recently renamed from Flashlight to Delve.
I like the name and MS retired it, so I'm going to try to stick with it.
Maybe it's an expected outcome in your system, but this is going to AttributeError if things don't go your way https://github.com/iLoveTux/delve/blob/v0.7.0-dev/src/home/e...
Name might get punished by SEO engines soon. Because of "Let's delve into details"
Good point. because of this and a few other comments, I am planning on renaming the project soon.
Any ideas you would like to share?
I like the name. If everyone renamed their product based on HN comments, the marketplace would look like the home directory of a mentally unstable data hoarder.
It does sound like there are some collisions but that doesn’t really matter unless your CLI name clashes, in which case you have many options for adjusting it. The domain name can have suffix or prefix or just “analytics.” And realistically people are going to google “delve analytics” if they can’t find it.
Is the name a reference to LOTR or ChatGPT?
Neither. I'm using its English definition:
To research or make inquiries into something
How does it compare to Plausible, Matomo and Umami
Thank you for the question.
Those platforms seem to be web analytics platforms, purpose built to track and analyze data from visitors to your web site.
Delve, on the other hand, concentrates on ingesting large quantities of structured, semi-structured and unstructured text based data. Think log files, csv, json, xml, item descriptions, etc.
The closest product to Delve would be something like Splunk or ELK.
I would say Delve is easier to get started with than Splunk or ELK, but actually offers more control since you can easily write your own search commands and field extractions. Also, role based access control is implemented to give fine-grained access to data.
Also configuration is all in one place, backend databases are configurable (sqlite, postgres, MySQL and any other database that works with the django ORM) and more.
Please let me know if you'd like any more details.
Do you have a demo video?
I do have a video I made a while ago, but I dropped the ball on starting a youtube channel to publish it.
Any recommendations on where I can upload and share a video, preferably one that I could embed in my README.md?
Depends on the size, but I have seen a non-trivial number of GitHub projects that reference an .mp4 served by raw.githubuserassets.com in their readme
I would suspect the cheapest way of doing that is to create an issue, drag the mp4 onto it, and then you have a stable reference to use from within the readme
Just start the youtube.