Existence of the higher-order surface waves of the Goubau line is proved and their structure is analyzed. An efficient computational approach is proposed based on numerical solution to initial-value problems obtained by the parameter differentiation. Several applications and further research directions are discussed.