rust How do you get multiple urls at the same time in a synchronus function

tv6aics1 于 2022-12-13 发布在其他

关注(0)|答案(3)|浏览(119)

I am getting data from the open weather map API. Currently the data is being retrieved synchronously which is slow. However, the function has to be synchronous as it is part of a library, but it can call an async function. How might I still make concurrent requests to increase performance? A solution that does not use reqwests works, but reqwests is preferred.

fn get_combined_data(open_weather_map_api_url: String, open_weather_map_api_key: String,
                           coordinates: Vec<String>, metric: bool) -> Vec<HashMap<String, String>> {
    let urls: Vec<String> = get_urls(open_weather_map_api_url, open_weather_map_api_key,
                      coordinates.get(0).expect("Improper coordinates").to_string() + "," +
                          coordinates.get(1).expect("Improper coordinates"), metric);
    let mut data: Vec<HashMap<String, String>> = Vec::new();
    for url in urls {
        let request = reqwest::blocking::get(url).expect("Url Get failed").json().expect("json expected");
        data.push(request);
    }
    return data;
}

rust

来源：https://stackoverflow.com/questions/74765800/how-do-you-get-multiple-urls-at-the-same-time-in-a-synchronus-function

3条答案

按热度按时间

dba5bblo1#

The easiest is probably to use tokios new_current_thread runtime and blocking on the data retreival.

use std::collections::HashMap;
use tokio::runtime;
pub fn collect_data() -> Vec<HashMap<String, String>> {
    let rt = runtime::Builder::new_current_thread()
        .build()
        .expect("couldn't start runtime");
    let urls = vec!["https://example.com/a", "https://example.com/b"];
    rt.block_on(async move {
        let mut data = vec![];
        for url in urls {
            data.push(async move {
                reqwest::get(url)
                    .await
                    .expect("Url Get Failed")
                    .json()
                    .await
                    .expect("json expected")
            });
        }
        futures::future::join_all(data).await
    })
}

赞(0）回复(0）举报 2022-12-13

nwnhqdif2#

You need an asynchronous runtime in order to call asynchronous functions. The easiest way to get one is to use the #[tokio::main] attribute (which despite the name can be applied to any function):

#[tokio::main]
fn get_combined_data(
    open_weather_map_api_url: String,
    open_weather_map_api_key: String,
    coordinates: Vec<String>,
    metric: bool,
) -> Vec<HashMap<String, String>> {
    let urls: Vec<String> = get_urls(
        open_weather_map_api_url,
        open_weather_map_api_key,
        coordinates
            .get(0)
            .expect("Improper coordinates")
            .to_string()
            + ","
            + coordinates.get(1).expect("Improper coordinates"),
        metric,
    );
    futures::future::join_all (urls.map (|u| {
        async move {
                reqwest::get(url)
                    .await
                    .expect("Url Get Failed")
                    .json()
                    .await
                    .expect("json expected")
            }
    })).await
}

赞(0）回复(0）举报 2022-12-13

h43kikqp3#

If your program isn't already async, probably the easiest way might be to use rayon .

use reqwest;
use std::collections::HashMap;
use rayon::prelude::*;

fn get_combined_data(open_weather_map_api_url: String, open_weather_map_api_key: String,
                           coordinates: Vec<String>, metric: bool) -> Vec<HashMap<String, String>> {

    let urls: Vec<String> = get_urls(open_weather_map_api_url, open_weather_map_api_key,
                      coordinates.get(0).expect("Improper coordinates").to_string() + "," +
                          coordinates.get(1).expect("Improper coordinates"), metric);
    
    let data : Vec<_>= urls
        .par_iter()
        .map(|&url| reqwest::blocking::get(url).expect("Url Get failed").json().expect("json expected"))
        .collect();
    
    return data;
}

赞(0）回复(0）举报 2022-12-13

我来回答

rust How do you get multiple urls at the same time in a synchronus function

3条答案

相关问题

热门标签

最新问答