Categories

Methodologies

Semgrep: modern SAST in your pipeline

Semgrep has grown into one of the most pragmatic static analyzers in the ecosystem. A look at why it works where other SAST tools fail, and how to fit it into a pipeline without turning it into noise.

Artificial Intelligence

DataFrames and Pipelines in Spark: Data Processing Optimisation

Spark DataFrames are distributed, schema-based tables that the Catalyst engine optimises automatically, while pipelines chain those transformations into a reproducible end-to-end flow. Together they let you process large data volumes efficiently across a cluster, scaling from a laptop to hundreds of nodes without rewriting code.