The People Directory profiles are displayed in minimal mode. That means only the email and the phone numbers are visible. This behaviour is not changeable for now.
But there is an issue to enhance this profile view for additional profile elements. You can vote on it to increase it's importance.
With the release of User Profile Plugin 1.8 additional elements can be displayed in the people directory. You only need to /wiki/spaces/upp/pages/9414188. After that the profile cards displayed at the people directory are rendered as /wiki/spaces/upp/pages/9414180. So the administrator can define which elements will be displayed by checking "Display in custom mode" in the /wiki/spaces/upp/pages/9414188.