This project explores transformer architectures for knowledge graphs. DuetGraph performs coarse-to-fine reasoning by fusing global structural views with local neighborhood information through dual pathways, improving reasoning over large and complex knowledge graphs.