On the first buffer the base class would update the segment position based on the start-time-selection. If the subclass provides its own segment this will caused unexpected behaviour and override segment information that was explicitly set by the subclass.
CC @meh
1.18 milestone because the update_segment() API is new in 1.18 and we should probably get the behaviour right