NVIDIA A2 16 GB

A2 and T4: the GPUs in our range that remain supported in CUDA 13

As CUDA 13 drops Maxwell, Pascal and Volta, the A2 (Ampere) and T4 (Turing) from our range remain in official CUDA Toolkit 13.x support. We separate the CUDA Toolkit, the driver and the AI libraries, show that the P40/V100 still work on CUDA 12.x and, with an application → card table, suggest when paying extra for an A2/T4 makes sense and when more VRAM at a lower price is better.

10 August 2026

GPUs for a laboratory or university without an H100 budget - how to build an AI/HPC workstation for less

If you conduct research, manage a grant budget or buy equipment for a student research group, sooner or later you hit the same wall: a new data-centre accelerator costs as much as a year's stipend for several PhD students. The answer I arrived at myself after several purchases for my own testing needs is unglamorous: buy used data-centre hardware, choose the card for the specific task rather than for the marketing, and accept that this hardware will not last you a decade.

3 July 2026

Tesla P40 vs V100 for a local LLM/RAG - 24 GB of VRAM or the faster Volta?

In our measurements the V100 generated text 2.6–3.1× faster than the P40 with the same model and quant, but the first question is whether the bottleneck of your RAG is generation, or retrieval and context processing. Data from one model, one backend and one methodology for three cards.

28 October 2026

Why the prompt is slow on a P40 - and how to really improve it

The Tesla P40 generates tokens decently, but processing a long prompt (prefill) is slow on it, because the P40 (GP102) has no Tensor Cores and does not offer high FP16 throughput.

21 October 2026

2× GPU for LLMs: how llama.cpp splits a model between P40 and V100

Two cards will let you run a model that does not fit on one, but not because the VRAM adds up into one big pool. llama.cpp and Ollama split the model into layers and distribute them between the cards.

14 October 2026

Whisper in Polish on a GPU - transcription and subtitles locally (GDPR)

Whisper (and preferably faster-whisper) transcribes Polish very well, and locally on a GPU it does so quickly and without sending recordings to an external service. In our test the V100 32GB reached ~15× realtime, and the P40/A2 ~6×.

7 October 2026