“The town people [of Nagasaki] were out in holiday attire to take the air and look out on the bay and stare at the General. After we had made our tour of the fairgrounds the Governor asked General and Mrs. Grant to plant memorial trees.
“The species planted by the General was the Ficus religiosa [‘sacred fig tree’], while to Mrs. Grant was given the Saurus camphora [‘camphor tree’]. The Governor then said that Nagasaki had resolved to erect a monument in honor of General Grant’s visit, that this memorial would be near the trees, and that if the General would only write an inscription it would be engraved on the stone in English and Japanese characters. The General wrote the inscription as follows:
‘At the request of Governor Utsumi Tadakatsu, Mrs. Grant and I each planted a tree in the Nagasaki park. I hope that both trees may prosper, grow large, live long, and in their growth, prosperity and long life be emblematic of the future of Japan’.“
– Around the World with General Grant, Vol. 2, by John Russell Young, 1879
“Nagasaki (AP) – Today we have bad news for General Grant. Some scalwags cut down his old banyan.
“They not only cut it down – they piled the site high with stone and rubble … Twings, leaves, trunk and memorial tablet all vanished – the Grant banyan is gone, a casualty of the second world war.
“… Glenn Rabb, Associated Press foreign editor, learned that Grant’s banyan memorial had been cut down with several other trees three years ago  to make space in which to dump dirt and stone from air raid shelters dug in the surrounding hills. Neither park or adjoining temple shrine was affected by the atomic bomb, which exploded several miles away. No trace of Grant’s banyan tree or memorial tablet, both victims of the American air campaign, is left.”
– Lawrence (KS) Journal-World, November 15, 1945
From the wiki: “After leaving the White House, General Ulysses S. Grant embarked on a world tour. Grant’s tour was initially planned as a private affair with no set duration but grew to assume diplomatic proportions when the Rutherford B. Hayes administration, aware of Grant’s popularity in Europe, encouraged him to extend his tour and voyage around the world to strengthen American interests abroad, an unprecedented undertaking for a former President. The Grants dined with Queen Victoria at Windsor Castle, and Grant gave several speeches in London.
“After a tour on the continent, including Switzerland, the Grants visited Scotland, afterward spending time with their daughter Nellie, who had married an Englishman and lived in Southhampton. Grant and his wife then journeyed to Paris and Italy, spending Christmas 1877 aboard USS Vandalia, a warship docked in Palermo. After cruising the Mediterranean, the Grants took a winter sojourn through Egypt and the Holy Land followed by a visit to Greece, before returning to Italy and a meeting with Pope Leo XIII. In 1878, they toured the Netherlands before moving on to Germany.
“In Russia, Czar Alexander II talked to Grant about the future of the Plains Indians. After touring Spain and revisiting Paris, the Grants returned to England. From England, the Grants left by private ship, sailing into the Mediterranean and stopping at Marseilles, then across to Alexandria visiting Egypt hurriedly and on through the Suez Canal to India. They visited cities throughout the Raj, welcomed by colonial officials.
“After India, they toured Burma, Siam (where Grant met with King Chulalongkorn), Singapore, and Cochinchina (Vietnam). Leaving Hong Kong, the Grants visited Canton, Shanghai, and Peking, China, where he criticized the autocratic attitude of Westerners toward the Chinese, which he compared to that of antebellum slave owners … [C]rossing over to Japan on the USS Richmond, Grant met the Emperor Meiji.
“Homesick, the Grants left Japan sailing on the City of Tokio, escorted by a Japanese man-of-war, crossed the Pacific and landed in San Francisco in September 1879, greeted by cheering crowds.”