Background Complementary and Alternative Medicine (CAM) is widely used and popular among patients with primary headache or low back pain (LBP). Aim of the study was to analyze attitudes of headache and LBP patients towards the use of CAM. Methods Two questionnaire-based surveys were applied comparing 432 primary headache and 194 LBP patients. Results In total, 84.75% of all patients reported use of CAM; with significantly more LBP patients. The most frequently-used CAM therapies in headache were acupuncture (71.4%), massages (56.4%), and thermotherapy (29.2%), in LBP thermotherapy (77.4%), massages (62.7%), and acupuncture (51.4%). The most frequent attitudes towards CAM use in headache vs. LBP: "leave nothing undone" (62.5% vs. 52.1%; p = 0.006), "take action against the disease" (56.8% vs. 43.2%; p = 0.006). Nearly all patients with previous experience with CAM currently use CAM in both conditions (93.6% in headache; 100% in LBP). However, the majority of the patients had no previous experience. Conclusion Understanding motivations for CAM treatment is important, because attitudes derive from wishes for non-pharmacological treatment, to be more involved in treatment and avoid side effects. Despite higher age and more permanent pain in LBP, both groups show high use of CAM with only little specific difference in preferred methods and attitudes towards CAM use. This may reflect deficits and unfulfilled goals in conventional treatment. Maybe CAM can decrease the gap between patients' expectations about pain therapy and treatment reality, considering that both conditions are often chronic diseases, causing high burdens for daily life.