【问题标题】:How to improve performance by saving results of queries in tables如何通过将查询结果保存在表中来提高性能
【发布时间】:2023-03-15 03:15:02
【问题描述】:

我正在处理一个非常大的数据库,我们希望使用在线数据可视化软件来显示它的数据。我的问题是数据库太大了,我无法在 30 秒内运行特定的查询。这使得可视化数据的体验非常糟糕,因此我需要找到一种方法来更快地执行我的查询。

我一直在评估运行一个维护计划,该计划运行一个过程,该过程每 30 分钟左右将此查询选择到一个表中。我想知道这是否是一个好方法,或者我是否可以进一步优化我的查询。

我在下面添加查询:

SELECT
    CY.CycleGroupName AS CycleName,
    FF.WBSCode, 
    CC.CostCenterCode,
    CC.Name AS CostCenterName,
    IIF(FF.ClientSpecific = 'Overhead', CC.GlobalLocal, 'Local') AS GlobalLocal, 
    PC.ProfitCenterCode,
    PC.Name AS ProfitCenterName,
    FN.ForecastNodeCode AS ForecastNodeCode,
    FN.Name AS ForecastNodeName,
    FN.GSGeographicUnit,
    FN.GSCountry,
    FN.Domain,
    FN.Location,
    CO.Name AS CountryName,
    CO.Classification AS CountryClassification,
    GU.Name AS GeographicUnitName,
    GU.GeographicAreaCode,
    ReportLine2,
    ReportLine3,
    ReportLine4,
    IIF(RL.IsGrossCost = 'Yes', 'Gross Cost', '') AS GrossCostClassification,
    ProductivityCategory,
    FF.ClientSpecific,
    FF.ResourceID,
    FF.CurrencyType,
    CO.CurrencyCode AS LocalCurrencyCode, 
    FF.InputCurrencyCode AS InputCurrencyCode, 
    FF.Comments,
    FF.FiscalMonthNumber,
    FF.Amount * Multiplier AS Amount
FROM
(
    SELECT
        CQ.CycleName,
        FF.TemplateID,
        FF.HeadcountID,
        FF.BorrowedID,
        CT.CurrencyType, 
        FF.WBSCode,
        FF.CostCenterCode,
        FF.ProfitCenterCode,
        FF.ForecastNodeCode,
        FF.CountryCode,
        FF.ReportLine,
        FF.CostElementCode,
        'T' + CAST(FF.TemplateID AS NVARCHAR) + 'H' + IIF(FF.HeadcountID IS NOT NULL, 'H' + CAST(FF.HeadcountID AS NVARCHAR), 'B' + CAST(FF.BorrowedID AS NVARCHAR)) AS ResourceID,
        FF.InputCurrencyCode,
        FF.ProductivityCategory,
        FF.ClientSpecific,
        FF.Comments,
        FF.FiscalMonthNumber,
        IIF(CT.Number = 30, FF.Amount * FX.Sep, FF.Amount) AS Amount
    FROM dbo.FinancialsForecast FF
        LEFT JOIN dbo.CyclesQuarters CQ ON FF.QuarterCode = CQ.QuarterCode
        LEFT JOIN dbo.CurrencyTypes CT ON 1 = 1
        LEFT JOIN dbo.CostCenters CC ON FF.CostCenterCode = CC.CostCenterCode 
        LEFT JOIN dbo.Countries CO ON ISNULL(CC.CountryCode, FF.CountryCode) = CO.CountryCode
        LEFT JOIN dbo.FXRates FX ON CO.CurrencyCode = FX.CurrencyCode AND FF.Year = FX.Year AND FF.QuarterCode = FX.QuarterCode
    WHERE
        CQ.CycleName IS NOT NULL
        AND FiscalMonthNumber > CQ.LastActualsMonth
    UNION ALL
    SELECT
        ISNULL(CQ.CycleName, 'Previous Actuals') AS CycleName,
        NULL AS TemplateID,
        NULL AS HeadcountID,
        NULL AS BorrowedID,
        FA.CurrencyType, 
        FA.WBSCode,
        FA.CostCenterCode,
        FA.ProfitCenterCode,
        NULL AS ForecastNodeCode,
        FA.CountryCode,
        NULL AS ReportLine,
        FA.CostElementCode,
        NULL AS ResourceID,
        NULL AS InputCurrencyCode,
        ProductivityCategory,
        FA.ClientSpecific,
        NULL AS Comments,
        FA.FiscalMonthNumber,
        FA.Amount
    FROM dbo.FinancialsActuals FA
        LEFT JOIN dbo.CyclesQuarters CQ ON FA.Year = (SELECT Value FROM dbo.Settings WHERE Name = 'CurrentYear')
        LEFT JOIN dbo.WBS W ON FA.WBSCode = W.WBSCode
        LEFT JOIN dbo.BusinessActivitiesLevel1 B1 ON W.BusinessActivityLevel1Code = B1.BusinessActivityLevelCode
    WHERE
        FA.Year >= (SELECT CAST(Value AS INT) FROM dbo.Settings WHERE Name = 'CurrentYear') - 1
        AND FiscalMonthNumber <= ISNULL(CQ.LastActualsMonth, 12)
) FF
    LEFT JOIN dbo.CostCenters CC ON FF.CostCenterCode = CC.CostCenterCode
    LEFT JOIN dbo.Countries CO ON ISNULL(CC.CountryCode, FF.CountryCode) = CO.CountryCode
    LEFT JOIN dbo.ProfitCenters PC ON CC.ProfitCenterCode = PC.ProfitCenterCode 
    LEFT JOIN dbo.ForecastNodes FN ON ISNULL(ISNULL(CC.ForecastNodeCode, FF.ForecastNodeCode), PC.ForecastNodeCode) = FN.ForecastNodeCode 
    LEFT JOIN dbo.GeographicUnits AS GU ON CO.GeographicUnitCode = GU.GeographicUnitCode 
    LEFT JOIN dbo.CostElements CE ON FF.CostElementCode = CE.CostElementCode
    LEFT JOIN dbo.ReportLines RL ON ISNULL(CE.ReportLine, FF.ReportLine) = RL.ReportLine AND RL.Number = 4
    LEFT JOIN dbo.ReportLinesLevels RLL ON RL.ReportLine = RLL.ReportLine4
    LEFT JOIN dbo.CyclesGroups CY ON FF.CycleName = CY.CycleName

【问题讨论】:

  • 也许您可以发布原始查询和表定义等,看看我们是否可以帮助优化查询。在这一点上,任何人都可以猜测,因为没有任何实际细节。
  • 您是否真的以各种可能的方式优化了查询?
  • 如果可能的话,也许你应该考虑实现分页
  • 我刚刚编辑了问题以添加查询,所有使用的表都有一个主键,而不是 FinancialsActuals 表。我还在必要时添加了索引。我考虑过为表本身建立索引,但由于它在我的数据库中使用了许多表并返回比原始表更多的行,我担心性能提升不会太多。

标签: sql sql-server query-optimization


【解决方案1】:

评论有点长。

表面上每 30 分钟运行 30 多秒的查询似乎是合理的。然而,它带来了各种各样的问题。特别是,用户可能会重新加载数据并看到事情发生变化——有时。不连续的用户体验通常是一件坏事。而且,大约 2% 的后台负载可能会影响其他查询的其他性能。

我的反应是:只有在万不得已时才这样做。数据库有多种提高性能的选择——索引、分区、改进的 SQL、SSD 磁盘(例如)。应用程序本身可以创建一个临时表。虽然这最初会消耗 30 秒,但后续使用该表应该很快。

【讨论】:

  • 谢谢 Gordon,根据要求,我在问题中添加了查询的详细信息。
猜你喜欢
  • 2014-04-13
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 2022-01-08
相关资源
最近更新 更多