Yes, you can certainly do this, and you don't even need to do anything special or create many separate offers.
Person B uses appendrawexchange to add what they are willing to offer, and what they want to receive. These are not the full amounts, so the output will be a not-yet-balanced transaction.
This transaction is itself a new offer of exchange, with outstanding amounts offered and received, that can be passed on to other participants. They can treat it like any other offer of exchange.