Proxy-advisory firm Institutional Shareholder Services Inc. recommended shareholders reject a proposed merger of two Samsung Group companies, dealing a blow to a closely watched deal that is key to a succession plan at South Korea’s biggest conglomerate.