Its called the "Gutter"
SynEdit has a property of this name, which has sup-properties.
You can turn it invisible.
It also displays bookmarks (if you define them/ assign images) or folding (e.g. for html if you use the right highlighter)
Individual parts can be configured via SynEdit.Gutter.Parts