fontspec error, font not found

When using package fontspec (or its derivative unicode-math), compilation fails with

! error:  (type 2): cannot find file ''
!  ==> Fatal error occurred, no output PDF file produced!

What happened here and how can it be fixed?