To get the benefit of today’s computer hardware, parallel processing is
a must. The hardware can do it - the problem is programmers conveying
their wishes through a programming language.
I have spent 35 years in the area of parallel processing.
I started in the late 1970’s with the massively-parallel, very low
level systems built around Associative Parallel Processing - intelligent
memory.
This required micro-code level understanding, and specialist hardware,
but delivered parallelism limited only by the number of chips you could
bolt together - an SIMD (Single Instruction, Multiple Data) offering that
died through lack of hardware, among other things.