The area of research you are looking for is market microstructure, the study of how markets work and the process of price formation. Naturally, this means studying liquidity, information diffusion, uncertainty, and dynamic games. There is not a lot of mechanism design in market microstructure -- though work along those lines would certainly be welcomed.
For an introduction to the area, a good first read might be Foucault, Pagano, and Röell's book. (Sadly, the review articles which come to mind are old.) The Journal of Financial Markets is chock full of microstructure research and you would do well to start following it.
FX markets have been changing recently with more retail flow and trading on ECNs while the inter-dealer network has become less segregated and more affected by trading on those ECNs. Thus the old Olsen & Associates work like the book by Gençay, Dacorogna, Muller, Pictet, and Olsen (2001) might help explain the interbank market but won't be up-to-date.
More relevant (and shorter) would be to check into Evans and Rime (2019).