Probing nanoscale light-matter interactions requires simultaneous access to optical anisotropy and ultrahigh spatial resolution. Here, authors develop torsional force microscopy-infrared imaging, enabling near-nanometer optical imaging and direction-resolved mapping of local optical responses.