We consider the structure of a finite groups having a normal series whose
factors have bicyclic Sylow subgroups. In particular, we investigated groups of
odd order and $A_4$-free groups with this property. Exact estimations of the
derived length and nilpotent length of such groups are obtained.