In my experience, no! I believe it depends more on a personal connection. When it clicks, it clicks (pun intended).
When both sides feel comfortable with each other, the resulting images are amazing. Good communication, previous mood boards and sharing ideas can help in the process. Over time I’ve been fortunate to build relationships with both female and male photographers, and the more often we work together the more comfortable both sides get! I cherish their trust in me and also am grateful to call a good number of them friends.