Notes
Curated TIL (Today I Learned) notes from a DevOps Engineer on cloud infrastructure, automation, and anything I learn along the way.
Inspired by jbranchaud/til and simonw/til.
Use terraform providers schema -json
and jq
to extract a complete list of all available resources and data sources for any Terraform provider.
By default, user-defined tags on an AWS ECS Service are not propagated to its Tasks, which can impact cost allocation. This can be fixed by setting the propagate_tags parameter.
When using DuckDB with AWS SSO, credential errors can occur when accessing S3. A shell function that wraps duckdb with aws configure export-credentials provides a seamless workaround.
Use a combination of AWS CLI commands like get-shard-iterator and get-records to fetch raw, Base64-encoded data from a Kinesis Data Stream for debugging.
PHP skipped version 6 because the project, which was primarily focused on adding native Unicode support, stalled due to complexity and performance issues. To avoid confusion with the failed effort and its associated books, the community voted to name the next major release PHP 7.
Find active queries with pg_stat_activity, then cancel them gracefully with pg_cancel_backend(pid) or terminate them forcefully with pg_terminate_backend(pid).
You can bypass the YouTube algorithm and get updates from all your subscribed channels by exporting them as an OPML file using YouTube-Subscriptions-RSS to be imported in your RSS reader.
When Amazon Data Firehose uses a Lambda for transformation, high data volume can exceed the AWS Lambda concurrent execution limit, causing processing delays. The most effective solution is to increase Firehose’s buffer size to reduce the number of Lambda invocations.
CloudFront has an undocumented burst limit on invalidation requests that can cause “Rate exceeded” errors even under normal usage.
Docker SSH mounts allow you to securely use your local SSH agent during docker build, for example to install private Git dependencies via SSH, without baking any keys into your image.