我有一个SQL数据库，我正在使用它来存储一个非常大的API的内容（大约300万个结果），因为我必须对它进行几次查询以进行数据分析，所以调用API来执行此操作的成本太高。我目前有大约一个月前存储的API数据，但我需要一种方法来保持最新的API数据。
我尝试使用的API是Texas Mixed Beverage报告：https://data.texas.gov/dataset/Mixed-Beverage-Gross-Receipts/naix-2893
新的结果不断地被添加进来，并且一些列的值也会发生变化。我更新数据的计划是在用户加载我们的网页时运行一个脚本，检查最近一个月的数据是否在数据库中，如果没有，它会获取整个月的数据并更新/插入它，然后在接下来的几个月里做同样的事情，直到找到匹配。
这并没有很好地工作，我最终与重复在我的数据库，不知道为什么。任何帮助或提示是赞赏！以下是脚本：

function update_mixed_bev($conn)
{
    $last_date = date('Y-m-d');

    $count = 0;
    // if not in db
    while ($count == 0) {
        // get most recent entry to mixed bev report
        $url = 'https://data.texas.gov/resource/naix-2893.json?$limit=1&$where=obligation_end_date_yyyymmdd%20<=%20%27' . $last_date . '%27&$order=obligation_end_date_yyyymmdd%20DESC';
        $json = file_get_contents($url);
        $data = json_decode($json, true);

        $row = $data[0];

        // query to see if data exists in db
        $location_address = mysqli_real_escape_string($conn, $row['location_address']);
        $location_name = mysqli_real_escape_string($conn, $row['location_name']);
        $record_end_date = date('Y-m-d', strtotime($row['obligation_end_date_yyyymmdd']));
        $sql = "SELECT COUNT(*) FROM mixed_bev_data WHERE location_address='" . $location_address . "' AND record_end_date='" . $record_end_date . "' AND location_name='" . $location_name . "' AND beer_receipts=" . $row['beer_receipts'] . " AND total_receipts=" . $row['total_receipts'];

        $result = mysqli_query($conn, $sql);
        $count = mysqli_fetch_array($result)[0];

        if ($count == 0) {
            $url = 'https://data.texas.gov/resource/naix-2893.json?$where=obligation_end_date_yyyymmdd%20=%20%27' . $record_end_date . '%27&$order=obligation_end_date_yyyymmdd%20DESC';
            $json = file_get_contents($url);
            $data = json_decode($json, true);

            // for each of month data
            foreach ($data as $row) {
                $taxpayer_name = mysqli_real_escape_string($conn, $row['taxpayer_name']);
                $location_name = mysqli_real_escape_string($conn, $row['location_name']);
                $location_address = mysqli_real_escape_string($conn, $row['location_address']);
                $location_city = mysqli_real_escape_string($conn, $row['location_city']);
                $location_state = mysqli_real_escape_string($conn, $row['location_state']);
                $location_zip = mysqli_real_escape_string($conn, $row['location_zip']);
                $record_end_date = date('Y-m-d', strtotime($row['obligation_end_date_yyyymmdd']));
                $beer_receipts = intval($row['beer_receipts']);
                $total_receipts = intval($row['total_receipts']);

                $sql = "INSERT INTO mixed_bev_data (taxpayer_name, location_name, location_address, location_city, location_state, location_zip, record_end_date, beer_receipts, total_receipts)
VALUES ('$taxpayer_name', '$location_name', '$location_address', '$location_city', '$location_state', '$location_zip', '$record_end_date', $beer_receipts, $total_receipts)
ON DUPLICATE KEY UPDATE beer_receipts = $beer_receipts, total_receipts = $total_receipts, time = CURRENT_TIMESTAMP();";

                if (!mysqli_query($conn, $sql)) {
                    echo "Error: " . $sql . "<br>" . mysqli_error($conn);
                }
            }

        }

        $last_date = date('Y-m-d', strtotime($record_end_date . ' - 1 day'));

    }
}