Hiring for a small team can be tough when there aren’t enough of you on the team to do what’s usually thought of as a standard interview.
The main reason why you involve so many people in interviewing a single candidate is because you want as many perspectives as possible. When you have a very small team (such as two people), the failure mode is that you only get two perspectives. That said, if you both like the candidate, then maybe there’s not really an issue.
My advice is to just do the interview like you would with a larger team: schedule multiple slots, and each person handles more than one interview topic. I’d also focus on interpersonal skills over raw technical ability. When you have such a small team, getting along well is more important than technical skills, in my experience.