Photoplethysmography (PPG) is a completely noninvasive, optical method of assessing blood flow dynamics in peripheral vasculature. Wearable devices for PPG recording are becoming increasingly popular, due to their cost-effectiveness and ease of use. For these reasons, many recent scientific studies have proposed the use of pulse rate variability (PRV) extracted from PPG as a surrogate for heart rate variability (HRV), in monitoring autonomic activity and cardiovascular health.In this work, we used a cross-mapping approach, a methodology based on chaos theory, to compare PRV and HRV dynamics, and investigate their agreement according to age and gender of healthy subjects. We used ECG and PPG data acquired from 57 subjects (41 young and 16 elderly) during resting state in the supine position. Signals were gathered from the publicly available VORTAL dataset. Our results showed a statistically significant decrease of PRV reliability as an HRV surrogate in old participants, which was confirmed as significant when only men subjects were analyzed (p-value<0.01).Our findings, although preliminary, suggest greater caution in the use of PPG devices for monitoring cardiovascular health, especially in elderly men.