Calcium pyrophosphate deposition (CPPD) disease is a rheumatic disorder frequently observed in elderly individuals, often presenting with symptoms resembling polymyalgia rheumatica (PMR). Despite differing treatment strategies for these conditions, a definitive method for distinguishing between them remains unestablished. We report the cases of four elderly patients initially presenting with polymyalgia (PM), ultimately diagnosed with CPPD disease. Early-stage CT scans in all cases demonstrated chondrocalcinosis (CC) in the shoulder and hip joints. These findings suggest that PM in CPPD disease is attributable to calcium pyrophosphate deposition in these joints. Moreover, the identification of CC via CT imaging may aid in differentiating CPPD disease with PM from true PMR. Further research is warranted to refine this diagnostic distinction.