So you are doing One-ways on the Pipes? Yeah that can reduce the overall throughput if done wrongly.
Maybe you want to use Drums as the endpoints of the Pipes behind the Filters instead of more Pipes? That could help. So Pipe -> Filter-On-Drum, instead of Pipe -> Filter-On-Pipe. This applies to both the Filter Cover and the Filter Block by the way.