The New York Stock Exchange is stirring tension between some of its big listed companies and their largest investors over regulators’ efforts to study the controversial practice of assigning fees and rebates to stock trades.

At issue is a Securities and Exchange Commission plan to study the system known as “maker taker,” in which exchanges charge fees for some trades and pay rebates on others.