At least right now, there is not a central place where all colors for all things are set, thus to change colors for various things you will need to change the source code (not recommended :). In any case thoug :
For the text of ports, look into TypePrefs.cs line #238
For connections, look into StyleSheet.cs line #255