Django

We've used Django for APIs, websites and shell commands.

Its an batteries-included python framework that we are comfortable with. From concept to production, its quick to develop in and easy to deploy.

Although its memory footprint is big compared to other languages and multi-threading can be interesting, it scales well, and easy to maintain.

Rest API

Rest API can be spun up in any language. Our niche is in python, rust, golang and nodejs.

APIs provide structured data endpoint that is secure with low latency.

LDAP & authentication

Authentication takes many forms. LDAP can delegate authentication to the client's infra.

Clients may want to have their internal user base and systems. When writing applications, we may choose to connect to these systems as external authentication platforms. It means that we do not have access to any internal data, we can create applications that respect data privacy in a trustless way.

Pipelines

Pipelines come in all shapes and sizes. Devops pipelines are one thing but data platforms are intricate data piping.

We have used Flink, Spark, NiFi and Confluent to try and ferry data from one place to another.

As part of data analysis, part of the data journey is collecting, cleaning, and storing data.

We can setup data harvesting, data mutations and data storage in different sinks.

As part of data lakes, we have used Postgres, Cassandra, and MongoDB as data sinks.

Python is a staple but we can use Rust and Java in processing data.