In the Eastern part of Latvia, Latgale, Jews came from Ukraine, Belarus and Poland in the 17th and 18th centuries, of whom most belonged to the Polish culture of Yiddish. A large part of their community life was managed by the kakhal (self-government). Latgalian Jews were very similar to the Jews from the Lithuanian-Byelorussian region, in the Lithuanian and Polish kingdoms. After the liquidation of the Livonian Order (1561), Poland overtook the province and governed it under the name Inflantia until 1772. No exact data is available on the first Jews, who likely arrived from Poland in the early 17th century after pogroms in Vilna, Sandomir, Brest, etc. between 1605-39. A considerable number of Jews arrived in Latgalia in the mid 17th century escaping from the pogroms and massacres of Bogdan Chmelnitsky and Cossack Raids (1648-1653) in the Ukraine and Byelorussia. These Jews were Yiddish-speaking and Orthodox, living in a self-governing community (kahal). The Census of 1766 recorded 2, 996 Jews in the region (not including children). Many of these Jews were peddlers.
In 1772, after the First Partition of Poland, the Latgalian province of about. 5,000 Jews belonged to Russia. In 1784 about 3,700 Jews lived in Latgalia. The three Latgalian districts of Ludza (Lutsin), Rezekne (Rezhitsa) and Daugavpils (Dvinsk, Dinaburg) were, after 1802, part of Vitebsk province (gubernia), within the Pale of Settlement. Jews were expelled from rural places to towns and subject to double taxation. From 1804 Jews were allowed to live only in cities and small towns (shtetlach). As distinct from Courland and Riga, the economy of Latgalia was poor, being located in the east, far from the Baltic Sea and close to Russia. In spite of poverty they maintained their traditional way of life and had many children, increasing the growth of the Jewish population, which was up to 11,000 in Latgalia in 1847. Under Czar Nicholas I (1825-1856) there was obligatory conscription into the Russian army, followed by the cantonist tragedy, especially when the special powers of Recruit Kidnappers were established.The Jews in Latgale practiced traditional Yiddish culture. Their neighbors were Poles, Byelorussians, Russian, and ethnic “Latgalians,” who spoke a unique dialect. The Jews of Latgale practiced typical Eastern European Orthodoxy. The Haskala was only a minor influence on their culture. There were factions of both hasidism (led by the Rogachover Gaon Iosif Rosin) and mitnagdim (led by Rav Meir Simha).
More info about Jews in Latvia
here!